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ABSTRACT 


This  report  describe;?  the  wor<^  oer formed  durinn  che  last  year 
on  a  contlnulnq  pro1ect"’to  develop  a  comouter  based  consultant  (CPC) 
system.  The  system  Is  being  designed  to  talk  (In  ordinary  English) 
with  a  human  user  to  helo  him  Perform  tasks  entailing  maintenance  and 
troubleshooting  of  electromechanical  equipment.^ 

our  plan  for  this  researcl*  calls  for  building  a  series  of 
Increasingly  sophisticated  systems  to  be  demonstrated  in  1976»  1977, 
and  197fl.  '^nur  current  (Aorli  i975>  demonstration  system  is  a  hate 
for  future  systems  and  already  Illustrates  abilities  to  Interact  with 
an  apprentice  to  help  him  assemble  a  small  air  compressor. 

The  body  of  the  report  Is  divided  Into  two  major  sections. 
One  of  these  describes  the  technology  behind  the  April  1975 
demonstration  system.  The  other  describes  work  In  oroqress  that  win 
contribute  to  the  power  and  versatility  of  future  demonstration 
systems . 


nur  1975  system  has  the  following  specific  abilities:  it  can 
generate  and  execute  olans  for  assembly/di sassembly  at  several  levels 
of  detail.  It  can  answer  queries  from  the  apprentice  about  the 
status  of  the  eguloment.  It  can  point  at  parts  of  the  compressor  and 
can  name  parts  pointed  to  by  the  apprentice.  It  has  a  rudimentary 
ability  for  two-way  communication  using  speech.  The  basis  for  each 
of  these  Is  described  in  detail.  _ _ .y 


Work  sonportlna  sobseTuent  systems  has  been  In  the  area  of 


natural  Janquaoe  understandlnq#  modellm*  troub leshoot Ing »  and 


vision.  Separate  sunrectlons  of  the  reoort  deal  with  each  of  these 


areas . 


The  report  also  describes  prodress  on  sone  supportlno 


activities  Including  the  SRi  Artificial  Intelligence  Center  Computer 


Facility,  the  language  QLISP,  hardware  Interface  work,  and  a  scanning 


laser  range  finder.  It  concludes  with  a  list  of  presentations  and 


publications  by  the  l:>ro1ect  staff. 
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Tne  Computer-Based  Consultant  Project 

1 .  Project  Goal 

For  the  oast  18  months  or  so  we  have  been  working  on 
a  system  that  we  call  the  Computer-Based  Consultant  fCBC).  The 
system  will  be  ablr  to  talk  (In  natural  language)  with  a  human  user 
to  help  Mm  perform  tasks  in  seme  particular  task  environment.  We 
Intend  to  build  a  Consultant  that  approximates  the  communication, 
perceptual  reasonlnn,  and  factual  knowledge  skills  of  an  actual 
expert  on  the  scene. 


Our  main  ooal  Is  to  create  the  fundamental  technoloov 
needed  to  build  such  consultant  systems,  we  expect  (or  hope)  that  a 
good  portion  of  this  technology  win  be  Independent  of  the  details  of 
the  oartlcular  kind  of  exoertlse  being  dealt  with  and  of  the  details 
of  the  particular  task  environment.  Tnus  we  view  our  work  as  having 
Potentially  high  nayoff  because  of  the  great  variety  of  applications 
in  several  task  environments  In  whlcn  consulting  expertise  is  needed 
or  would  be  useful  . 

?.  Background 

The  technoloov  of  computer-based  consultants  can  be 
viewed  as  stemming  from  the  confluence  of  two  lines  of  research.  One 
line  hf,s  centered  on  formulating  and  encoding  a  great  deal  of 


1 


‘cnowledqe  about  a  chosen  oroMem  doinaln  In  order  to  Produce  a  Proaram 


wheije  perforT.ance  rivals  exoert  humans,  Often  cited  examples  of  this 
research  Include  proqrams  that  analyze  chemical  structure  [l,21»« 
perfcrn  syrnhoHc  Inteoratlon  C’il#  nr  play  board  qames  [4,S»6], 

The  second  line  of  research  has  focussed  on  methods 
for  constructlno  a  proaram  that  can  carry  on  a  dlaloo  with  a  user, 
ImDortant  contributions  to  this  research  have  come  from  work  In 
computer  elded  instruction,  and  from  work  In  understandlnq  typed  and 
spoken  natural  lanauaqe.  Representative  examples  of  this  work 
Include  proqrams  to  carry  out  a  "mixed  initiative"  tutorial  dlaloq 
r7,R);  to  enqaae  In  a  dlaloq  about  a  toy  block  world  [9);  and  to 
Understand  sooken  FnaJlsh  sentences  about  such  diverse  topics  as 
olumbinn  [lO],  news  stories  ttU,  moon  rocks  [121,  or  submarines 
[  1 .1 1  . 


Perhaps  one  of  the  best  examples  to  date  of  a  small 
computer-based  consultant  Is  the  MYCIN  system  [141,  This  system 
provides  advice  to  physicians  on  the  dlaqnosls  and  therapy  of  certain 
classes  of  bacterial  diseases.  It  solicits  various  kinds  of  medical 
data  frr..  a  physician  user,  can  answer  his  ouestlons  (expressed  in  a 
hlahlv  restricted  natural  Fnqllsh  format!,  and  can  accept  advice  from 
him  renardlno  aeneraliy  useful  rules  for  dlaqnosls  and  theraPy. 


♦References  are  listed  at  the  end  of  this  report 


3.  ThP  Task  r*  ri v  1  r onr^^nt 

No  t  v:  1 1  hs  t  an  i  i  rn  onr  aoal  of  apvpiortnn  t 'inia  Tien  t  a  1 
and  widely  usetvil  terhnoloov*  tie  nust  ,  of  conrse,  selert  sotrp 
ParcicNlar  t^sk  environnent  for  the  TdC  svstpn,  .*'p  h^vo  at tonotpo  to 
select  a  task  environment  toat  is  an  innortant  <int‘ 1  i  cat  1  on  area  in 
Its  own  rIoNt  as  well  as  one  that  serves  wpl]  as  a  typical 
rcnresentatlve  of  a  wide  varletv  of  apollcatlons. 

Wp  have  Selected  the  task  of  rePairlnn,  modlfylno, 
and  chpcklno  out  compiey  elertroirechanlcal  eoulpment.  ')iir  cnr  system 
will  be  helplno  an  Inexperienced  Techanlr  fwho-r,  v^e  shall  call  an 
apprentice)  as  he  works  on  a  Piece  of  equipment  In  a  "workstation." 
The  kinds  of  nrohlens  encountered  uslna  this  particular  task 
environment  are  typical  of  those  of  many  other  environments. 
=”urthermore»  maintenance  of  eoulpment  is  an  Important  task  In  Itself, 
costlno  literally  billions  of  dollars  each  year,  7hus,  there  is  a 
hlah  potential  for  substantial  savlms  derivtm  from  improved 
efficiencies  in  this  one  application  area  alone. 

Before  discussino  tne  details  and  specifications  of 
the  CHC  system  itself,  let  us  first  hrlpfly  consider  some  of  the 
character  ist  Ics  of  eoulnment  ma  1  nten  =-,ncp  as  a  task  arei.  Irraolne  an 
apprentice  uorklnq  on  a  piece  of  eouipment  In  a  workstation  like  the 
one  sketched  in  fin u re  1,  Typically  he  Is  r»»snoPSlhlp  for  a  variety 
of  1ohs,  such  as  trouhi pshoot 1 m,  reoairtno,  or  nodifyino  equipment. 


In  ord»»r  to  do  those  1obs»  he  needs  certain  iclnris  of  specialized 
Knowipdne:  he  -nust  knoA'  ano'it  the  use  of  VHrlnus  tools,  about 
principles  ot  t  r  oijh  1  es  hoot  1  na  ,  and  about  principles  ot  assembly  and 
dlsassernhlv,  and  he  rrnst  also  kno*;  a  certain  amount  of  defall  about 
the  construction  and  noeratlon  of  the  sopcific  equloment  on  hand. 

6  traditional  waV  of  ronvevinn  this  Icpnwipiqp  fo  a 
mechanic  has  been  throuoh  the  use  pf  maeials,  4  more  rearlv  ideal, 
thou oh  usually  impractical,  wav  would  be  to  make  an  expait  human 
mechanic  continuously  available  as  i  consultant.  This  expert  could 
Identify  various  components,  answer  specific  Questions  about 
equloment  details*  suonest  t  r  ouh  1  pshoot  inci  seouences,  hypothesize 
causes  of  failure,  warn  of  hazards,  and  so  forth. 

In  order  to  healn  to  “xoiore  what  would  be  involved 
in  replaclno  the  human  expert  by  a  computer-based  expert*  we  recorded 
a  number  of  dlaloos  between  expert  human  mechanics  and  novice 
mechanics.  Tho  dlaloos  concern  the  air  compressor  shown  In  Flnure  ?. 
Two  excerpts  from  these  dlaloqs  are  presented  below.  At  the  time  the 
dlaloos  were  recorded,  the  expert  and  novice  were  in  different  rooms 
and  the  expert  viewed  the  scene  only  by  means  of  still  pictures  taicer 
throuoh  a  television  camera,  (We  did  fils  to  simulate  tne  limited 
Vjsuai  information  IDceiv  to  be  available  to  a  computer  based 
expert.)  The  first  excerpt  concerns  the  suhtask  of  installlnn  a  numn 


DUlleV  on  the  pumn. 


Fxpert;  The  rumo  ouliev  should  be  next, 

Amrentice:  Yes  ...  un»  d')<»s  the  side  of  the  numD 

puiiev  with  the  holes  face  awav  from 
the  rumo  or  towards  it? 

F;  Away  from  the  duidd, 

A :  A 1 1  r 1 oht , 

F:  Did  you  insert  the  v:ev--that  is,  the  half-moon 

shaped  oiece? 

A:  Yes,  I  did. 

F:  de  sure  you  cnectr  the  alionment  of  the  two 

pulleys  before  you  tiahten  .the  set-screws. 

A!  Yes,  I'ni  1ust  now  flddltno  with  that. 


rinhtenlnfi  the  Allen  scre^;  nov 


4 

! 

i 


l' :  I'K  ,  th<ink  vou. 


This  fraament  Illustrates  several  Important  abilities 
of  Consultants  that  contrast  sharoiv  -<ith  a  static  information  source 
litce  a  manual.  First*  notice  that  a  question  from  the  apprentice  is 
answereh  rlirectiv  ana  in  his  terms.  There  is  no  need  for  him  to 
search  throuqh  a  nass  of  information,  or  to  convert  information  from 
an  abstract  or  "standard"  form  into  a  directly  usable  form,  .Jotlce 
that  the  exo-rt  is  chect^.lno  oh  oroqress  hv  offerin'?  wamlnos  and 
reminders  about  critical  steos.  This  has  the  function  not  only  of 
mlnlmlzlno  errors*  but  also  of  allovlnn  the  expert  to  )c«»eD  track  of 
the  oroaress  of  tne  work.  The  latter  function  is  the  ba‘-ls  for  the 
expert's  ability  to  present  relevant  advice*  and  to  present  It  in  a 
context  that  Is  fan-iiiiar  to  the  apprentice. 

The  second  dlalon  excernt  concerns  the  same  suptask* 
but  was  carried  out  with  different  part  Ic  Ipants.,  Tt  offers  an 
Interestlnq  comr arisen  of  the  different  demands  imposed  oy  different 


Skill  levels: 


Kxcerpt  7 


Fxpert-:  Install  the  pulTev  on  the  shaft. 

Apprentice:  What  Is  the  first  thlna  to  do  in 

Installlm  th**  nulley? 

F:  Rotate  the  shaft  so  that  the  slot  (Icevwav)  is 

on  the  top, 

A:  OK  ,,,  now  what? 

F:  Place  the  iceV  in  the  slot, 

A:  Flat  sue  uoward? 

F:  Yes. 


This  Short  fraament  dramatically  Illustrates  “.he 
ability  of  the  expert  to  descend  into  detailed  instructions  in  order 


to  help  a  very  nalvp  user.  Tn<s  aoorentlce  neeos  fr.'.jcn  more  hpl.>  than 
the  first  one  a  situation  foreshahriwe-i  bv  nis  initial  niiestlor 
about  a  relritlvely  siniple  oneratlo’i, 

"^hese  short  'ila.loa  excerrts  exenpilfv  so'ne  of  the 
ablllt<ps  that  a  oonsuitant  rep<1s  in  orier  to  he  heU’fui  to  the 
aoDrentlce  iTipphflnlr .  both  Introsnection  anti  nrotoool  exnerlrrents 
Dolnt  out  a  i.u|T>her  of  other  renuirpH  abilities,  air-ono  which  are  the 
ability  to  provlHe  advice  about  trouol eshopt 1 m*  to  describe  the  use 
of  tools;  to  describe  th^  anoearance  of  tools  for  to  be  able  to  oolnt 
them  out!:  and,  of  course,  the  ability  to  use  lanouaoe.  fUe  shall 
have  morP  to  say  In  a  later  section  aboijt  how  ve  are  usinc  protocols 
of  this  sort  tu  deslon  the  subsystem  for  orocesslno  natural 
lanauaae ,  1 

hurlPQ  the  oast  year  we  have  been  uslno  the  simple 
air  compressor  of  fidure  2  as  an  exemplar  Piece  of  equipment.  While 
the  device  appears  to  be  reasonably  simple,  certain  of  its 
suhaisemhi  les  are  rather  complex.  For  example,  the  air  pumn,  shown 
In  Fiaure  3,  contains  a  laroe  number  of  Parts  put  toaether  in  complex 
fashion . 

The  compressor  has  served  us  well  as  a  healnnina 
device,  but  we  are  now  ready  to  move  on  to  some  more  complex  devices. 
We  are  esoeclallv  anxious  to  select  a  device  demandlna  rather 
sophisticated  trouhleshootlm  sixllls,  ve  exoact  to  make  a  decision 
soon  about  which  new  device  to  use.  Several  candidates  are  discussed 
In  the  Appendix, 


Model  Numbers 


(17199)  102,17200 
(17209)  102.17210 


102.17220  (172)0)  102.17021 

102.17001  102.17046 

102.17011  102.17041 


RelerrKf 

Number 

Pwr 

Nuffibet 

NAMf:  OF  PART 

Reference 

Number 

Pan 

Number 

NAME  OF  PART 

1 

690 

A(nfco«>lcf  KlUi*  */•"  Here  Tube  i  'a**  Pipt* 

Pump  -  b*  r  1  ifure  9 

H 

12191 

Prf».u..  Switch  Ipr  117209)  102  17210,  102  17720  (17218) 

K 

Admotiltr  (<M  102.17001.  102.17011, 

102.17011.  102.17021  and 

11)2.17021,  Id2.|70t6  •inil  I02.|70tl 

102.17041 

\ 

^7ll^7 

Afiercooler  <<w  (17199)  102. 17200.  (17200)  102  17210. 

I) 

ness 

Prraaure  Switch  for  102.17046 

n^i 

12776 

0009 

1129? 

•rtd  102.17220  (17218) 

H 

42475 

Pft  saure  Switch  for  (17199)  102  17200 

S 

(• 

7i 

:b 

I'IImi*  <  unm  1  t»«f-  '  «*'  Tube  i  N"  p»|<c  Thiee«J 
<  b«  ck  Vjl»i'-Ai\  F  (fuic  4  (of  p4fis 

Namiplmi' 

Oil  Oram  NippK  Vt"  i  |  ona 

U 

n 

I8S9I 

Pressure  Switch  Belief  Valve,  then  orderinf 

Relief  Valve  give  Pressure  Sviieh  Nameplaie 

Da.a.  (Ref.  No.  15) 

CheiV  Valve  Relief  Tube  (al»e  avniUble 

H 

»W79 

T^nk  ami  Plailurm  Aanembly  lot  (|7|<^)  102  17200, 

16 

I8SV) 

loc.iily  %**  aluminum  or  copper  tube  51/^  loflf. 

(17209)  102  1  7210,  102  17220  (1  7218) 

S..(pt>  v«l.p(or  102.17001,  102.17011, 

N 

H7W 

Tank  .ind  Pl.ii(<irm  A^>rmbl)  lo  M4>s4rhu^M<t 

102.17021,  102. 17046  tnd  102.17041 

ApecilKaiioni  (or  (17199)  102  17200, 

16 

IBM4 

Massnchuserr.s  Safety  Valve  (or  (17199)  102  17200, 

4WRI 

(17209) 102.17210,  and  102  1 7220  (17218) 

(17209)  102  17210.  102  17220  (17218),  102  17001, 

Tank  .iiid  Pl.ifltirm  A'>\embl)'  102  1  TOO  I 

I02.I70II,  102.17021,  102.17046  ind  102.17041 

4^42 

17 

Motor  or  Gas  tn|ine>-Sef  Motor  Nameplate  and 

102.  ITT)  16  .ind  102. 17041 

(>as  Engine  Pan  booklet  for  characieriarics; 

N 

4(78^ 

Tank  and  Plailmm  A«s<mhly  lu  Masqat bu^eiis 

when  wtring  regarding  motor  or  engine  service 

Spr<  ilu  antin',  lur  192.17021, 

include  complete  nameplate  data. 

I02.n)46  anil  102.17041 

IH 

4M)54 

Motor  Hullc-y  (oi(l7l99)  102.17200 

•> 

16614 

Maniluld  (<>r  moumina  Pr*  nM>.e  Soiicb, 

IR 

4V)SR 

Motor  P-iMry  !iit(l7209)  102  17210  ind  If;. 17021 

(nr  102. 17U2I.  102. 1-^46  ami 

IH 

dSOSS 

Motor  Pulley  for  102.17001  and  102.17011 

102.17041.  IN<-  liir  all  Spt  ciliraifuns 

IH 

•IS0S9 

Motor  Pullty  (or  102  17220  (17218)  and  102  17041 

9 

M721 

Maniltild  (tH  nmunnnf  Pn  s^ure  S*<irh  ami 

IH 

40S45 

Motor  Pulley  (or  102.17046 

(•auai  ,  (bain )  Valti  .ind  Dm  har^i- Valvr 

19 

17469 

belt  (or  102.17001  (){"  wide 

included)  (or  (17)99)  102.17200.  (17209)  102  17210, 

102  1  7220  0  7218)  and  102  17001.  Not 

19 

17470 

n  44”  lung) 

Reli  (or  102  17220  (17218).  102.17021  and  102  17041 

1(1 

12^71 

PifSNUii  (.au|f  loi  102.17001,  IU2.I70II, 

19 

IH556 

(H  ’  wide  n  47”  long) 

102.17021,  102.17046  and  102.17041 

Bell  (or(l7209>  102  17210  (1^”  wide  n  46”  long) 

Id 

n79^ 

Pienauie  Caufe  lor  (17199)  102  17200,  (17209)  102.17210, 

10 

IRIRI 

Boll  for  102. 170 II  nnd  102.17046  (11"  wido 

and  102  17220  07218) 

n  4'”  long) 

in 

17088 

Pit'>surr  Ciauat'  (or  Siafe  ol  Ma . . -n  hwsciM 

19 

42622 

Be.  (or  (17199)  102  17200  -  H"  *iue  n45"  long 

11 

9^949 

Oi^chaiai  Valve  lor  102.17001.  1-12.17011, 

Niii  .Shown 

96S7() 

IU2.I7021,  102.17016  and  102.17041.  Al-rn 

Niii  Shown 

'KiHOO 

u>ed  on  MasH,  bpecilicmion  mndela  (17199)  102.17200, 
(17209) 102  17210  and  102  17220  (17218) 

Noi  Shown 

M.»)l 

Tank  Dram  Valve  Only  fur  Stare  of  Maas. 

12 

HX  evnduii -Available  locally  (See  Inaiallaiinn 

Nt*i  .Shown 

1)429 

Cord  and  Plug  Assembly  for  102.17501. 

Inairucriona  for  wire  nize) 

Nor  **bown 

4)-1«) 

102.17400  and  102.17410 

Adapter  Ground  Plug  (or  102. 17504 

102.17400  and  102.17410 

SA-1530>56 


FIGURE  3  PARTS  LIST  FOR  AIR  COMPRESSOR 
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Prolert  nro'^nizif  ion  l  '■•'‘tho'i  of  Aroro^cb 


i^p  have  alrediv  statpH  that  r>nr  ooal  for  tbp  CBb 
orolprt  Is  to  build  a  systPT  tbat  aonroxl'^a^’ps  a  huiri^n  expert.  T'r  is 
tflthpr  difficult  for  us  now  to  orpdlct  orpclspiv  iust  hpw  fine  or 
coarse  this  aocroxitrat  Ion  will  be  anv  qlven  future  tlmp.  Tn  our 

early  plans  for  the  rroiect  tl5l  we  stated  some  uereral 
specif Irat  1  ons  for  a  system  we  believed  would  op  derronstrable  in 
197R.  Cui’rpnt  proorpss  on  the  nrolert  reinforces  our  confiderce  In 
beino  able  to  achieve  ari  impressive  svstpm  nv  that  time. 

In  olannlno  our  woric  we  have  relied  heavily  on 
studvlna  tape -r pco r oed  olaloos  between  nunan  experts  and  apprentices. 
From  these  we  have  extracted  various  requirements  for  our  io?n 
demonstration  system.  In  summary  these  are: 

(1)  The  '/stem  will  ne  abl»  to  Plan  loolral  seouences 
of  actions  to  accnmollsh  aoals.  These  ooals  will 
include  a  ranae  of  tasics  Involvlno  check-out, 
maintenance#  t roubl eshoot  Inn#  repair#  and 

as s eii'b  1 V /d  1  sas semb  1  V  of  enuioment, 

(2)  TheSe  sedUpnces  of  actions  will  he  Planned  to 
whatever  level  of  detail  is  appropriate  to  the 
apprentice's  ability  and  to  the  other  requirements 


o^  the  system 


f  to  obtain  lnfnr"iation  vi^u^^iiv 
cns  Of  thp  aoprentlco  and  the 


S  of  fOe  eqijlnment 


research  questions  Into  four  catenories:  nrobl  e-n-sol  v  1  nq  »  natural 
lanauaqe»  vtslon»  and  system  Intearatlnn.  Fach  catenorv  has  Its  own 
team  of  researchers#  althounh  there  Is  considerable  overlan  and 
sharlnq  of  personnel  between  each  of  these  t«as><s,  Hur  strateov  Is 
that  as  research  proqresses  on  the  first  three  of  these  topics#  the 
Interim  results  will  Immedlatelv  he  Inteurated  into  a  qrowino 
demonstration  system.  Thus#  at  any  time#  the  current  version  of  the 
demonstration  system  can  oe  tak-en  as  a  measure  of  rrooress  toward  our 
197  8  qoa 1 s  , 

The  nrowlna  demonstration  svtem  Ji^lll  he  an  important 
tactjc  to  ensure  prorer  communication  between  various  parts  of  the 
oroiect.  we  are  also  usJnq  It  to  structure  major  subqoals  and 
schedullnq.  We  have  defined  certain  subsidiary  abilities  that  should 
be  achieved  by  each  of  three  major  demonstrations  to  occur  each  April 
in  197f.#  and  1  977  Tlfl  . 

A  description  of  the  abilities  of  the  CRC  system  at 
the  time  this  report  went  to  press  Is  olven  In  the  followlnq 
oaraqranhs,  Suhsenuent  sections  of  the  report  w.iii  describe  the 
details  of  the  technoloaV  underivinq  this  oresent  (April  197S)  system 
and  the  worlc  belno  done  in  support  of  future  systems. 


B. 


The  1*57^  DPFonst rat  1  on  System 


1  . 

that  exhibits 
describlnq  the 

worl<'statl  on . 
containinq  the 


General 

In  this  section  we  shall  descrtbe  a  demonstration 

the  current  abilities  of  the  svstem.  we  beoin  hv 
settlno  of  the  demonstration. 

The  Place  where  the  action  takes  olare  is  called  a 
It  Is  a  room,  apor ox  1  TT>ate  1 V  11  feet  by  feet  in  size 
follow  inn  items: 

A  wori^benrh  with  a  tool  box  and  tools, 

A  round  table  with  a  turntable  too  on  which  Is 

Placed  a  small  air  compressor:  this  is  located  In 
the  middle  of  the  room  with  access  from  all  sides. 

A  computer  terminal, 

A  microphone  headset  with  a  lorn  cord  that  will 
reach  to  any  point  in  the  room. 

A  SPeaker/ampit f ier , 

A  TV  camera,  to  tinted  near  the  celiino  on  a  movable 
pan/tilt  bead. 

A  TV  display  CRAmjEK)  on  which  Is  displayed  a  TV 

picture  of  the  air  compr'*ssor,  with  a  surerlmposed 
line  drawing  of  the  air  compressor. 

A  laser/rangef Inder  mounted  near  the  TV  camera. 

The  air  compressor  Is  in  a  Partially  disassembled 


15 


condition 


The  belt  hooslrn  cover  ■=inri  he]t  are  reiroveri  and  lylna  on 


the  workbench.  The  diitio  holts  are  rp'T'oved,  and  the  nUT.p  is  turned 
away  frotr  its  norTial  orientation. 

The  aporentlc**  enters  the  roonr  and  walks  to  the 
terminal  and  finds  the  fo)]o'.'’lnq  mnssaie:  "Your  qoal  is  'Assenh]pd 
A Irconnressor ' ,  Please  out  on  the  headset  and  sav  'Peadv'  Into  the 
microphone.  The  computer  wni  nlve  vou  verbal  instructions.  You  can 
say  any  of  the  followlnn  responses: 

UK  Indicates  vou  can  do  the  task. 

Indicates  vou  need  more  letailed  Instructions. 

v:hy  indicates  Vou  want  to  know  the  motivation  for  the 
particular  Instruction  lust  received, 

HUH  or  WHAT  or  pLHASK-phtkat  Will  cause  the  last 
command  to  te  repeated, 

wheHF  is  THF  ...  or  SH'IW  MK  THE  ...  followed  by  the 

name  of  a  component  wni  result  in  Positlonin 
of  the  laser  ranoeflnder  heam  on  that  component. 

WHAT  IS  THIS,  coupler!  with  Vour  toUchlnq  a  component 
with  the  Hohted  wand,  will  oet  vou  the  name 
of  the  component. 

PPFAK,  PAUSF,  or  WAIT  will  cause  an  Interrupt  in  the 

proaram  execution  so  that  vou  mav  use  the  terminal 
to  querv  the  nrooram  ahrjijt  the  state  of  thlnos. 
(Sorry,  there  is  no  voice  I/n  for  these  queries). 

LOCATION  OF  ...  followed  bv  the  name  of  a  component  will 
result  In  posltionlnq  of  the  laser  beam  on  the 
location  where  the  component  Is  to  be  positioned. 


CALiTbHATF.  irvokps  f\  r^llhr'=^t|on  spO'iencp  tor  C'^'T'pr.=i, 
laspr,  rflnapr, 

FI\’r,  rnf'piJKSSnp  causes  thP  K^ser/ranqpr  to  ripterminp  the 
location  ^n'i  orieot'^tlon  ot  the  cor^ pressor  .ind 
update  Its  •models  anH  dlsolavs  accordimlv. 

Mj-Lf-’  Cleans  tti^t  sonipthino  has  none  '"ronn.  ap  wtii 

pya.Tlnp  fhp  prprpdlm  steps  and  net  vou  an  pxnprt 
Person  It  necessarv. 

Please  adjust  the  headset  and  proceed  ’vhen  von  are 

ready. " 

Onaiitatlvp  Anjuties  of  tnp  ('n'lnutpr  based  Consultant 

The  alillltiPS  of  the  CBC  are  alluded  to  In  the  Ust 
of  responses  oJven  above#  and  tore  details  will  he  presented  In 
Sertlon  II.  In  sumnarv,  the  CBC  contains  a  system  tor  olannlnq 
assembly  or  disassembly  of  the  air  compressor.  The  plan  is 

represented  by  a  structure  called  a  procedural  net  which#  in  this 
demonstration#  Is  built  from  a  orespecifled  disassembled  state  of  the 
comoressoi',  namely  the  one  described  above,  Fach  step  of  the 
assembly  dan  can  be  olven  at  several  different  levels  of  detail# 
denendlnq  on  the  needs  of  the  Particular  aporentlre.  The  nroqram 
keens  an  Internal  model  of  the  "connectedness"  of  the  different 
components  of  the  air  comnressor.  It  also  contains  a  qranhlcal 
(absolute  positions)  mod*>l  of  the  locations  of  the  different 
components.  At  the  present  time  these  mioaeis  ^re  limited.  The 
qraphlcal  model  "knows  about"  the  oumo#  •"otor#  pressure  switch#  belt 


hoMslnQ  frarrie,  bPlt  hoosim  rov^^r#  pomp  oullev»  motor  DOllev, 
Diatform,  tan^»  and  table.  The  connectivity  model  "knows  about"  all 
the  visible  components,  but  the  two  models  do  not  as  yet  Interact 
with  each  other. 


The  CbC  Is  able  to  alve  resoonses  usinn  the  voice  of 
the  Votrex  Phonorre  svpthesizpr  (described  in  detail  ir  .“Section  ri.F..2 
below")  and  can  understand  sooken  Instructions  uslna  the  VlP-loo 
Phrase  recoonlzer  (described  in  section  Tl.F.i).  The  TV  camera  is 
used  In  obtainlno  the  location  of  the  brl'ihtest  point  In  its  field  of 
view.  This  is  useful  in  cooperation  with  the  laser  beam,  both  in 
callbratlno  the  oraphical  system  and  also  In  answerlno  questions 
about  names  of  particular  parts  ot  the  compressor.  The  laser  beam  Is 
oronram  controlled,  and  can  he  moved  to  Point  at  a  olven  component, 
or  to  indicate  calibration  points. 


Kben 

these 

various 

ahj litles 

are  combined,  they 

produce  a 

system  that 

is 

aireadv 

rather 

unique  and  Impressive. 

Further 

deve 1 opment 

1  s 

needed 

for 

each 

ahllltv,  and  the 

syst em-hu i 1 dl no  task  is  an  onoolm  one  (see  Section  11. F).  Other 
abilities  viii  be  added  as  thev  become  available.  In  particular 
these  are  a  natural  lanouaoe  capability  (see  Section  TIl.B)  and  a  use 
of  vision  (scene  analysis)  to  aid  the  problem  soivim  (see  Section 


III.D) 


3  . 


of  a  CHC/ftr'^r “nM  O'*  Interaction 


The  follo'^’lnt  sl-rulated  il^loa  hetwppp  an  exnert  (K1 
3ni  an  apnrprtlcp  fA)  sho*'s  tpp  ahlJlties  ot  thp  systpo  as  nf  Aoril 
l^7S,  The  interaction  is  hy  vnlre,  with  usf  of  co'nnprciallv’ 
avaiiahip  devices  for  voice  recoonltlon  ani  voice  svnthesis. 

P:  TRY  TO  ACHIFVF  AFSFMPLFn  A I prOMpRFSSUP 
A:  MOW? 

F;  THF.  TOP  I.E'VEL  PF  A^'  IS  Ifv'STALfj  PU'-'P,  IN.’STAt.F,  p|l^^ppp/\('(^  ^ 

TNSTAM,  F>UMFPliI,I  FY  ,  INSTAU,  RFLT,  AND  HFSTALIj  liKLTHOIJS  T  Nf^C  dV  FR 
F:  HFAPY  FDR  QUF.STinNS 
A:  vSHriw  MF  THF  PdMP 
(Laser  heap  povps  to  point  at  pupo) 

E!  RFADY 

A:  .SHOW  MF  THF  MOTOR 

(Laser  heap  povps  to  noint  at  potorl 

F.:  READY 

A:  WHERE  rs  THF  Hf  FTFOIJS 1  MGFR A^'F? 

(Laser  beam  moves  to  oolnt  at  the  be  1 1 hous Inq f r amp ) 

F;  PFADY 

A:  WHAT  IS  THIS?  (Tobchino  tank  Platform  vlth  wand) 

E:  TAHK  PLATFORM 
E:  PFADY 

A:  WHAT  Is  THIS?  (Poiotlnn  with  wand  at  nressnre  switch) 

F:  PRFSSURF  switch  COVER 
E:  READY 


E:  TNSTAIil,  PliwP 


MOW? 

CONNFXT  PUMP  TO  PLATFORM 
HOW? 

POSITION'  p'iMp  ON  PLATFORM 
LnCATTOP  OF  PUMP? 


(Laser  beam  moves  to  point  at  numoolace  on  olattorni 


A :  OK 

F:  POSITION  PUMP  on  PLATFOP'-l 
A:  HO'^? 

E;  PLACE  TUF  PUMp  Ob  THE  PLATFORM  TM  SUCH  A  l^-AY  THAT  HOLES 
IN  THF  Plivp  are  matched  UP  WITH  HOLES  IN  THF  PF.ATFORM 
A:  OK 

F;  ATTACH  pilMp  TO  PLATFORM 
A;  HOW? 

E;  USE  BOLTS  TO  ATTACH  PUMP  TO  PLATFORM 


A:  HOW? 

E:  C,FT  4  ONE  ANO  A  OUAFTER  INCH  «  S/IA  HEXAGONAL  HOLTS  AND 

4  5/tS  hole  DIAMETER  FLAT  WASHERS  AND  4  SIZE  P/J6  HEXAGONAL  NIJTS 
A;  HHH? 

(Apprentice  did  not  hear  the  command) 

E;  GET  4  ONE  AND  A  QUARTER  INCH  i  S/lh  HEXAGONAL  BOLTS  AND 

4  S/IS  HOLE  DIAMETER  FLAT  WASHERS  ANO  4  SIZE  P/16  HEXAGONAL  NUTS 
A:  HOW? 

E:  GET  I  UME  AND  A  QUARTER  INCH  «  S/16  HEXAGONAL  BOLT 
A;  ALI.  RIGHT 

E:  please  rephrase  your  answer 
(Expert  did  not  reconnlze  the  response) 


U-- 

■v'-A-AnTnT-.T-.' 


W*'  -*• 

M  *■,*  '  '  V*  -  "  ■  '  ^ 
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A 

E 

A 

e 

A 

E 

A 

E 

A 

tr 

A 

E 


OK 

get  'INE  b/16  HHF  K  DIAMETER  ELAT  wASHER 
OK 

get  one  size  Q/lh  HEXAGOMAt,  ‘lUT 
OK 

GET  3  GNE  and  a  nUARTER  iNCH  «  s/16  HEXAGONAL  HOLTS  AND 
3  S/16  HOLE  DIAMF'TER  FLAT  WASHERS  ANi)  ^  SIZE  Q/16  HEXAGOTJAF,  flHT, 
OK 

LOnsEI Y  FASTED  THE  4  HOLTS 
HC'W? 

START  IN  n‘'F  HOLT 
HOW? 

PUT  THE  ROI  T  THROUGH  THE  HOLE  IN  PHMPHASE  AMO  PI.ATEORH  AND 
washer  AND  TURN  THE  MUT  CLOCKWISE  ONTO  THE  BOLT  AS  EAR 


A 

E 

A 

E 

A 

E 

A 

E 

A 

E 

A 

E 

A 


AS  YOU  CAN 
OK 

LOOSELY  FASTEN  THE  OTHER  3  HOLTS 
OK 

tighte:n  the  4  bolts 

HOW? 

tighten  one  holt 

HOW? 

EIND  A  SIZE  Q/is  wrFNCH  TO  FIT  THE  NUT 
OK 

einp  a  size  1/2  Inch  krefch  to  fit  thf  bot.t  head 

OK 

USE  THF  FIRST  WRENCH  TO  HOLD  THE:  NUT  FIRMLY 

OK 
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K: 

E; 

A: 

E; 

A: 

E: 

A: 

E: 

A: 

E: 

A* 

E; 

A: 

E; 

A: 

E; 

A : 
E ; 
A; 
E: 

A; 
£ : 
A; 
E: 

A  ' 


nSE  THK  SECO'in  n;^fc:^!CH  TO  TirpN  r^F.  BOLT  ri.QCKrtlSt:  UMTfT.  FAlPl.Y  TIGHT 
OK 

tighten  the  UTHFF  3  HQLTB 
OK 

INSTALL  PHMPBPACK 
HOw? 

CONNECT  PUHpBRACt  TP  HELTHOMS I NGFR AMF 
HOW? 

POSITION  pllMpBpACE  OM  BFXTHOUSIMGFrAMF  AND  pOslTTON  pUMpBRACE  OM  PlIMu 
OK 

ATTACH  PIIMPBRACF  TO  HFLTHOUS INGERA ‘■IE 
HOW? 

USE  SCREWS  TO  ATTACH  piJ^^PBRACK  TO  HFLTHOUS I  NGFw  A  ME 
How? 

get  7  half  inch  t  14  SCRE^vS 
UK 

LOOSELY  FASTEN  THE  7  SCREWS 
HOW? 

START  IN  ONE  SCREW 
MOW? 

START  IN  THE  SCREW  BY  TURNING  IT  CLOCKWISE  AS  '-1IICH  AS  YOU  CAN  IJNTTL 
IT  HOLDS  THERE  BY  ITSELF 
OK 

LOOSELY  FASTEN  THE  OTHER  SCREW 
OK 

TIGHTEN  THE  2  SCREWS 
HOW? 

TIGHTEN  ONE  SCREW 
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E;  FIMD  A  SCPEwnplVFR  THAT  WILL  FIT  I  Win  THF  wnrCM  riF  tHK  RCPFW 
A:  WHY? 

E;  IN  OROER  rn  tighten  THF  1  SCREW 
A;  WHY? 

E;  IN  order  to  USfc?  SCREWS  TO  ATTACH  PiIMrPrACF  TO  Hh  IiTHO'lS  INGFrAME 
A;  WHY? 

E;  IN  Order  to  attach  PH'^PBRACF  to  BFI.tHOHSINGFRAWE 
A;  WHY? 

E:  IN  ORDER  TO  CONNECT  PUMPRRACF  TO  HEITHOUST NGFr aMF 


A : 
E: 
A; 
E: 

A; 
E! 
A : 
E; 
A ; 

A; 
E; 
A; 
E: 
A : 
E; 
A: 


WHY? 

IN  ORDER  TO  INsTAI  L  PU'^dhrACE 
WHY? 

next  steps  ark  to  INSTAI. L  PUMPPULLEY  AMD  INSTALL  PELT  AND 

INSTALL  BEl.THPi;slNGCO’'F.R 

WHY? 

IN  ORDER  TO  TRY  TO  ACHIEVE  ASSEMBLED  A I  RCOMprESSOr 
WHY? 

ASK  the.  ROSS 
OK 

find  a  SCRF:WDPTVFR  that  will  fit  Into  THF  notch  np  the  SCREW 
OK 

usF.  the  screwdriver  to  turn  the  screw  clockwise  IINTIT.  tight 

OK 

tighten  the  other  screw 

OK 

connect  PUMPb.RACE  TO  plIMP 
OK 
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CONNKCT  PlIMPPUl.Lt'Y  TU  PU^r 


% 

I  t 

■*  • 


E 

E 

ft 

E 

A 

E 

A 

E 

ft 

E 

ft 

E 

ft 

E 

ft 


HOW? 

POSITION  PUMppULLF.y  O'!  pUMp 
HOW? 

pi  ftCE  THE  PUMPPIILLKY  ON  THE  PUMp  SHAFT  IN  SUCH  A  WAY  THAT  THE  FLAT 
SIDE  OF  THE  SHAFT  IS  ALIGNED  WITH  THE  FLAT  PAWi  INSIDF  THE  CENTER 
HOLF  OF  the  PliMppULLEY  ANP  THEN  PUSH  THE  PljMppilLLFY  ONTO  THE  piJHp 
SHAFT  AS  EAR  AS  YOU  CAM 
OK 

ATTACH  PUMPPUI.LFY  TO  PUMP 

now? 

ATTACH  the  PIlMppULlEY  TO  THE  SHAFT  OF  THE  PUHp 
HOW? 

get  7  OUAPTFR  INCH  #  1/4  SETSCREWS 
OK 

LOOSELY  FASTEN  THF  2  SETSCREWS 
MOW? 

START  IN  ONE  SETSCREW 
HOW? 

START  IN  THE  SETSCREW  BY  TURNING  IT  CLOCKWISE  AS  MUCH  AS  YOU  CAN 
UNTIL  IT  HOLDS  THF HE  BY  ITSELF 
OK 

LOOSELY  FASTEN  THF  OTHER  SETSCREW 
OK 

TIGHTEN  THE  2  SETSCRfc:ws 
HOW? 


TIGHTFN  nrih'.  SF'ISCFKW 
HOW? 

find  a  SIZF:  ]/P  am  FW.'/JRF'.NrH 
OK 

TWPN  THF'.  SFTSrpF'W  CLOCKWIS'-'  UNTIL  TIGHT 
HOV,  . 

INSF:rt  TMF!  SHdrTF'P  HFXAGnUAL  KNU  OF  THF  AM.FnWPF'NCH  IN  TO  THF". 
HEXAGnNA[<  HOLF  OK  tHK  SFTSCPFVv  AND  THKM  TUHN  TUF  SF.TGChF.W 

OLorKwisF;  until  tight 

OK 

TIGHTEN  THF.  OTHKP  SFTSCPFW 
OK 

INSTAIL  F^FI.T 
HOW? 

CONNECT  HFLT  TO  unrOKPULLFY  AND  CONNECT  HFLT  TO  PlIMpPlJLLFY 
HOW? 

POSITION  PFLT  (IN  MnTnppiJLLFY  ANP  POSITION  BFILT  ON  PU’'IPF'ULLFY 
HOW? 

PI  ACF.  RFI.T  IN  GHOOVF  OF  HOTORPULLFY 
OK 

PLACF  belt  in  GPOOVF  OF  PUVPPULLFY 
HOW? 

IF  YOU  HAVE  TPOUHLF  GETTING  THF:  BFLT  ApOlIND  THK  PlHPPUT.LFY  THY 
MOVING  THE  MOTOP  WHICH  MAY  MEAN  I.OOSFN  I  NG  THE  FASTEN  ILGS  TO  ALLOW 
IT  TO  SLIDE  SIDFWAYS 
OK 

ATTACH  F'FLT  TO  MOTOPPUI  LEY  AnP  ATTACH  BELT  TO  PUMPPULLFY 


Finished 


c. 


Uroan 1 za t i OP  of  the  Feoort 


mentioned,  we  have  ornanlzed  wnrk  in  the  prolert  under 
four  headings:  orohiem-solvlna,  nafura]  lannuade,  vision,  and 
system  Irteoratlon,  Each  of  these  research  areas  entails  two  types 
of  Work,  First  there  Is  some  "Immediate"  work  that  is  now  helm 
incorporated  Into  the  demonstration  system.  Second  there  Is  some 
lonaer  term  research  that  win  nave  an  Imoact  on  future  systems. 

Father  than  oroanlzino  the  reoort  Into  separate  sections 
correspondino  to  the  four  research  topics,  we  have  decided  to 
describe  in  section  n  the  work  In  each  cateaorv  fhaf  underlies  the 
Aorll  1^75  system.  This  will  give  the  reader  an  idea  of  how  the 
oresent  system  works  and  an  unoerstan dlno  of  its  deficiencies.  Then 
in  vSectlon  ill  we  shall  describe  the  work  whose  Impact  win  ne  felt 
In  later  systems. 

In  addition  to  the  front-line  research  toPics,  the  rrolect 
needs  the  help  of  several  important  suoportlng  tasks.  These  are 
maintenance  of  and  Improvements  to  the  ni.TSP  l.anguage,  maintenance  of 
and  improvements  to  the  SRi  Artificial  Inteliloence  Center  computing 
system,  and  development  of  certain  hardware  Items  such  as  the 
scanning  laser  ranoe  finder  and  Interface  equipment.  These 
supporting  tasks  win  pe  described  In  Section  TV, 

Section  V  lists  the  Publications  and  presentations  of  tne  Chc 
project  staff  during  this  reporting  nerlod. 
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COMPONENTS  OF  THE  aPPIL  1975  SYSTEM 


A.  Introduction 

Our  1975  systerr  has  already  Inteqrated  several  abilities.  it 
can  qenerate  and  execute  plans  tor  assembly/dlsassembly  at  several 
levels  ot  detail.  It  can  ans*/er  queries  from  the  apprentice  about 
the  status  of  the  equipment.  It  can  point  at  parts  of  the  compressor 
and  can  name  parts  pointed  to  by  the  aporentice.  It  nas  a 
rudimentary  ability  for  two-way  communication  using  speech.  It  is 
the  purpose  of  this  section  of  the  report  to  describe  just  what 
underlies  each  of  these  abilities. 

In  Section  b  we  shall  discuss  our  wor'^  in  qeneratinq  and 
executing  hierarchical  plans.  This  worx  has  resulted  In  the 
development  of  a  concept  called  the  "procedural  net  for  representing 
hierarchical  Plans."  The  basic  work  on  the  procedural  net  has  been 
done  by  Earl  Sacerdotl  as  part  ot  his  doctoral  research.  In  Section 
C  we  shall  describe  the  pointing  abilities  of  the  system.  Underlying 
pointing  Is  a  "geometric  model"  of  the  compressor,  work  on  this 
model  and  on  Pointing  Is  largely  the  work  ot  Jerry  Agin  and  Georgia 
Sutherland,  with  some  Important  early  contributions  by  David  Nltzan. 


In  Section  D,  a  modeling  package  developed  by  Hlchard  Flkes 
Is  described.  This  package  is  used  for  maklm  deductions  on  the 
model  In  order  to  answer  queries  from  the  apprentice  and  from  other 


Darts  o£  the  system.  The  pacKage  also  provides  a  means  for  updating 
models  of  the  world  during  Planning.  The  current  system  uses  some 
features  of  this  package#  and  we  have  plans  to  use  additional 
features  soon. 

Our  simple  system  for  voice  I/O  is  described  in  Section  K. 
Tt  consists  of  a  speecfi  synthesizer  and  a  word  recognlzer--hoth 
commercially  available. 

Finally#  in  Section  F'  we  discuss  some  of  the  problems  of 
system  integration.  Georgia  Sutherland  has  been  responsible  for  this 
task#  and  it  necessarily  has  Involved  her  in  each  of  the  others  also. 

B.  Heasoninq  About  Assembly/Disassembly  Actions 

1.  Introduction 

The  assembly  and  disassembly  of  equipment  is  a 
subtask  ot  virtually  an  workstation  tasks.  For  example#  many 
troubleshooting  jobs  and  almost  all  repair  jobs  require  some  amount 
ot  disassembly  and  reassembly  ot  the  machine.  So  a  major  aspect  of 
the  consultation  task  is  to  modei  the  actions  entailed  in  assembly 
and  disassembly#  to  compose  sequences  of  these  actions  to  accomplish 
specific  tasks#  and  to  model  and  monitor  the  execution  of  these 
sequences  by  a  apprentice. 

Since  the  execution  ot  a  task  is  done  under  a  mixed 


initiative  reqlmen,  allowing  the  apprentice  to  jndertatce  subtasKs  In 
the  manner  he  chooses,  we  cannot  simpi/  oulM  a  valid  fixed  sequence 
of  actions  to  accomplish  a  task..  Father,  we  must  include  in  our 
model  the  apprentice's  implicit  freedom  to  order  the  individual  steps 
himself. 


In  addition  to  develoPina  a  metnodolodv  for  ouiidinq 
and  executing  hierarchical ly  organized  plans  of  action  that  reflect 
this  freedom  of  ordetina,  we  are  leveloolna  mettodolodies  for 
defining  a  hierarchy  of  relations  to  describe  states  of  Partial 
assembly,  and  for  defining  a  hierarchy  of  actions  to  alter  those 
states  . 


In  this  section  we  shall  first  Jlscuss  the  integrated 
problem  solving  and  execution  monitoring  system  developed  during  the 
last  year.  Then  we  snail  present  the  relations  and  action  models  that 
are  being  used  to  describe  electromechanical  equipment,  with  Portions 
of  the  semantic  model  of  the  air  compressor  included  as  an  example. 
Finally,  we  shall  describe  how  the  system  develops  the  dialog 
presented  in  Section  1. 

2.  An  Integrated  Problem  Solving  and  Execution 

Monitoring  System 

The  I'JUAH  (Nets  Of  Action  Hierarchies)  program 
combines  a  general  purpose  problem  solver  with  an  execution  monitor 
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thflt  Is  sppcltically  deslqned  for  man-machine  cooperation.  In  this 
section  we  shall  present  a  slmplltled  explanation  ot  the  procedural 
net,  nOAH's  representation  for  actions  and  plans,  of  SOUP,  the 
lanquade  tor  qivlna  the  system  tas<-speclflc  Knowledge#  of  the 
plannlnq  alaorlthm,  and  of  tne  execution  alaorithm,  A  complete 
discussion  ot  the  system  will  appear  elsewhere  tl7l, 

nuAh  is  Implemented  in  QLISP  tl8l,  and  runs  as 
compiled  code  on  a  PDP-IO  computer  under  tne  TPNEX  time-sharlno 
system , 

a.  The  Procedural  --^et 

The  system's  plans  are  built  up  In  a  data 
structure  called  the  procedural  net,  wnich  has  characteristics  of 
Doth  procedural  and  declarative  representations. 

Basically,  the  procedural  net  Is  a  semantic 
network  of  nodes,  each  ot  which  contains  procedural  information, 
declarative  information,  and  pointers  to  other  nodes.  Each  node 
represents  a  particular  action  at  some  level  of  detail.  The  nodes 
are  linked  to  form  hierarchical  descriptions  ot  operations,  and  to 
form  Plans  of  action. 

Nodes  at  each  level  of  the  hierarchy  are 
linked  In  a  partially  ordered  time  sequence  by  predecessor  and 


successor  links.  Kach  such  sequence  represents  a  plan  at  a  particular 
level  of  detail. 

In  the  current  liiPlerrentatlon»  the  nodes  are 
of  six  types;  GOAL  nodes  represent  a  qoal  to  oe  achieved;  PhA'.nOM 
nodes  represent  noals  that  are  expected  to  be  true  when  they  are 
encountered;  SPi,iT  nodes  have  a  slnjle  predecessor  and  multiple 
successors,  and  represent  a  forklnq  of  tne  partial  ordering;  JOlfJ 
nodes  have  multiple  predecessors  and  a  single  successor,  and 
represent  a  rejoining  of  subPlans  -»lthin  the  Partial  ordering;  BUILD 
nodes  represent  an  action  tnat  builds  up  a  class  of  objects;  BHKAK 
..odes  represent  an  action  that  Is  Iteratively  applied  to  the  elements 
of  a  class  ot  objects. 

'Cach  node  points  to  a  body  of  code.  The 
action  that  the  node  represents  can  be  simulated  by  evaluating  tne 
body.  The  evaluation  will  cause  new  nodes,  representing  more 
detailed  actions,  to  be  added  to  tne  net.  It  win  also  update  a 
hypothesized  world  model  to  reflect  the  effects  of  the  more  detailed 
actions. 

Associated  with  each  node  Is  an  add  list  and 
a  delete  list.  These  lists  are  computed  when  the  node  Is  created. 
They  contain  symbolic  expressions  representing  the  changes  to  the 
world  model  caused  by  the  action  that  the  node  represents. 

Thus,  the  nodes  of  tne  Procedural  net  contain 
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tuo  very  different  representations  of  an  action.  Tne  add  and  delete 


lists  provide  a  declarative  representation  of  actions  that  is  quite 
similar  to  that  of  STRIPS  tiyj.  The  body  of  code  provides  a 
procedural  representation  similar  to  that  of  the  new  A, I.  lanquages 
[20],  The  declarative  representation  is  used  to  model  the  action  at 
the  node's  oWn  level  of  detail,  me  procedural  representation  is 
used  for  generating  more  detailed  subactions  at  levels  of  greater 
detail. 


Figure  4  shows  the  graphic  notation  used  here 
to  display  a  node  of  a  procedural  net. 


Predecessor(s)  I 


V 


Successor(s) 


Node  types  are  designated  as  follows: 


Description  of  action 

^  Description  of  action  ^ 

S 

D 

GOAL 

PHANTOM 

SPLIT 

JOIN 

TA-740522-1 1 


FIGURE  4  GRAPHIC  REPRESENTATION  OF  A  NODE 


As  an  example/  let  us  examine  a  procedural 
net  representing  a  hierarchy  of  Plans  to  paint  a  celling  and  paint  a 
stepladder.  The  plan  can  he  represented,  in  an  abstract  way,  as  a 
single  node  as  shown  in  Figure  5(a).  In  more  detail/  tne  plan  is  a 
conjunction/  and  miqht  pe  represented  as  in  Figure  5(b).  The  more 


^  detailed  subplans  to  achieve  these  two  goals  Tiiqnt  be  "get  paint 

ladder,  then  apply  Paint  to  ceiling,"  and  "get  Paint,  then 
paint  to  ladder,"  as  depicted  in  Figure  5(c), 


LEVEL  1 


Paint  the  ceiling  and  paint  the  ladder 
(a) 


LEVEL  2 


(b) 

TA-740522-12 


LEVEL  3 


LEVEL  3  (c) 

(After  Criticism 


(d) 


TA-740522-13 


,  get 
apply 


FIGURE  5  PROCEDURAL  NET  FOR  PAINTING 


The  pictorial  representation  used  here 


suppresses  inucn  of  the  Inforniatlon  associated  with  each  node.  The 
add  and  delete  lists,  tor  Instance,  are  not  indicated  in  the 
dlaqrams.  They  are  not  hard  to  Inter,  however,  for  example,  "get 
ladder"  win  cause  "has  ladder"  to  tc  added  to  the  wcrid  model,  and 
"apply  paint  to  celling"  might  delete  "has  oalnt"  from  the  world 
model . 


Precondltlon-subgoal  relationships  are 
Inferred  by  the  system  from  Pointers  that  li  dlcate  which  nodes 
represent  detailed  expansions  of  other  nodes.  These  pointers  are 
also  omitted  In  the  pictorial  representation.  The  system  assumes  that 
every  action  but  the  last  in  such  an  expansion  is  a  precondition  for 
the  last  action. 


b.  Tasx-Speclf Ic  Knowledge 

Knowledge  about  the  tasK  domain  Is  given  to 
the  system  In  procedural  form,  written  In  the  SOUP  (Semantics  Of 
User's  Problem)  language.  SOUP  is  an  extension  of  OLISP  118)  that  is 
Interpreted  In  an  unusual  fashion.  The  process  of  planning 
transforms  this  procedural  Knowledge  Into  the  hybrid  procedural  net 
form,  which  contains  both  procedural  and  declarative  Information,  and 
Which  represents  a  hierarchy  of  solutions  to  the  particular  problem 
at  hand. 
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we  will  tirst  present  the  statetr.ents  of  SDUP 
that  have  been  added  to  QliSP,  (We  will  call  them  P-statements . )  Then 
we  will  describe  now  the  snjP  code  is  interpreted.  Specific  examples 
of  SOUP  code  are  presented  ip  Section 

P-statements  that  refer  to  actions  are: 

PGOAL  - 

A  PGOAL  statement  Is  of  the  form; 
(PGOAl  query  pattern  APF^LY  team). 

Its  meaning  is  similar  to  the  QLISP 
GOAL.  It  has  an  additional  argument# 
t  query#  that  specifies  a  verbal 
request  for  the  goal  to  be  ahleved. 
Evaluation  of  a  PGOAL  results  in  the 
insertion  of  a  new  node  in  the 
procedural  net.  it  a  true  Instance 
of  the  goal  pattern  is  found  in  the 
world  model#  a  PHANTOM  node  is  created 
If  no  true  Instance  is  found#  a  true 
GOAL  node  is  created. 


PBUILQ 


A  Pi'JlLD  statement  is  of  the  form; 
(PBUlLl)  class-name  query  ( ITEKATF- , ,  , ) )  , 
It  specifies  an  action  that  ^lill 
build  up  a  class  of  ob:)ects.  The 
query  is  a  verbal  request  to  nuiid  up 
the  class.  The  iterate  statement 
contains  an  arbitrary  body  of  code 
that  specifies  the  subactions  entailed 
in  processinq  one  element  of  the  class. 
Evaluation  of  a  PBUILD  statement 
results  in  the  creation  of  a  BUIT.h 
node  in  the  procedural  net. 


PBHEAK  - 

PBBEAK  has  the  same  syntax  as  PBUILl). 

It  specifies  an  action  that  Iterates 
through  a  pre-existlnq  class  of  oblects. 
Evaluation  of  a  PBREAK  statement  results 
in  the  creation  of  a  BREAK  node  in 

3 


the  net 


A  PAND  statement  Is  of  the  form: 


(PAnD  exp-1  exD-2  ...  exp-n), 

PANi)  specifies  a  collection  of 

expressions  that  may  be  evaluated 
independently.  Execution  of  a  PAM) 
statement  results  in  a  n-way  branchlnq 
in  the  procedural  net. 

P-statements  that  refer  specifically  to  the 

world  model  are: 


PIS  - 

A  Pis  Statement  is  of  the  form:  (PIs 
exp).  It  searches  tor  an  instance 
of  the  exp  that  is  true  in  the  current 
world  model.  If  none  is  found,  it 
causes  a  failure  condition. 

PASSEPT  -  A  PASSEHT  Statement  is  of  the 
form;  (paSSEPT  exp). 

It  maxes  exp  be  true  In  the  current 
world  model  and  places  exp  on  the  add 
list  of  the  current  node  in  the 
procedural  net. 
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POEMY 


PDENY  Is  Similar  to  PASSEHT.  It 

makes  exp  be  taise  and  adds  exp  to  the 
delete  list  ot  the  current  node, 

i^hen  a  P -statement  that  refers  to  an  action 
(l.e.f  PGOAL,  PbUlLD,  PBRtAK,  or  PAND)  IS  evaluated,  it  does  not 
cause  an  arbitrarily  deep  computation,  as  would  most  PLANNER-llke 
languages  [20J  .  Rather,  the  action  is  mocked  (we  mean  i-lmuiatfd, 
but  we're  already  using  that  term  for  another  operation)  and  the 
world  model  Is  updated  as  If  the  deep  computation  had  been  done  and 
the  action  were  accomplished  In  full  detail.  The  Information 
necessary  to  continue  the  computation  to  further  depths  Is  stored  as 
the  body  ot  code  associated  with  the  new  nodes  that  are  cr .ated  In 
the  procedural  net.  For  example,  when  a  PGOAL  statement  Is  evaluated 
(thus  mocking  the  action  that  achieves  the  goal),  the  team  of 
functions  associated  with  the  statement  Is  placed  as  the  body  of  the 
new  node  representing  that  goal.  When  a  PBUILD  or  PBREAK  statement 
IS  evaluated,  the  ITERATE  clause  is  stored  as  the  new  node's  body. 
This  type  of  evaluation  results  in  the  creation  of  hierarchies  of 
Plans  of  increasing  detail.  This  scheme  thus  extends  the  ability  to 
do  hierarchical  planning  as  was  done  by  ABSTRIPS  [211  from  a 
syntactically  oriented  declarative  representation  to  SOUP's 
semantically  oriented  procedural  representation, 

c.  The  Planning  Algorithm 

Initially,  NOAH  is  given  a  goal  to  achieve. 


ivlOAH  first  builds  cl  brocedural  net  that  consists  of  a  single  goal 
node  to  achieve  the  given  goal.  This  node  has  i  list  of  all  relevant 
SOUP  functions  as  its  body,  and  It  represents  tne  Plan  to  achieve  the 
goal  at  a  very  high  level  of.  abstraction.  This  one-step  plan  may 
then  be  expanded  by  the  Planning  algorithm. 

The  planning  algorltnm  of  the  noaH  system  Is 
simple.  Its  Input  Is  a  procedural  net.  it  expands  the  most  detailed 
Plan  In  the  net  py  simulating  each  node  of  the  Plan  In  turn.  In 
addition  to  building  a  detailed  model  of  the  effects  of  each  action 
in  the  plan,  the  simulation  of  each  node  will  produce  child  nodes. 
Thus  by  Simulating  the  Plan,  a  new,  more  detailed  Plan  wm  pe 
created. 


The  Individual  subplan  for  each  node  will  be 
correct,  but  there  Is  as  yc-t  no  guarantee  that  the  new  plan,  taicen  as 
a  whole,  win  be  cofect.  There  may  oe  Interactions  between  the  now, 
detailed  steps  that  render  the  overall  plan  Invalid,  For  example, 
the  Individual  expansions  entailed  In  generating  the  plan  In  Figure 
5(c)  from  that  In  Figure  5(b)  are  correct,  yet  tne  overall  plan  Is 
Invalid,  since  it  permits  Painting  the  ladcer  before  painting  the 
celling. 


Before  the  new  detailed  plan  is  presumed  to 
work,  the  planning  system  must  take  an  overall  look  at  It  to  ensure 
that  the  local  expansions  make  global  sense.  This  global  examination 


Is  provided  by  a  qroup  of  critics.  These  critics  serve  a  purpose 
somewhat  similat  to  that  of  the  critics  of  Sussman's  hACKtH  [221, 
except  that  for  ixJAH  they  are  constructive  critics^  desioned  to  add 
constraints  to  aS  yet  unconstrained  Plans,  wnereas  for  HACKt'R  they 
were  destructive  critics  whose  purpose  was  to  reject  incorrect 
assumptions  reflected  in  the  plans. 

For  example,  a  constructive  critic  will  alter 
the  Painting  plan  in  Figure  5(c)  to  ensure  that  the  endangered 
subaoal,  painting  the  ceiling,  is  achieved  .'efore  the  step  that 
endangers  it»  namely  painting  the  ladder.  After  this  critic  has 
altered  the  Plan#  it  win  aPPear  as  in  Figure  5(d).  Note  that 
Planners  that  use  a  linear  representation  of  plans  cannot  solve  such 
uroplems  witnout  extensive  use  of  bacKtr acklnq #  or  sophisticated  plan 
optimization. 

The  algorithm  for  the  planning  process,  then, 

is  as  follows; 

(1)  Simulate  the  most  detailed  plan  in  the 
procedural  net.  This  win  have  the  effect 
of  producing  a  new,  more  detailed  plan, 

(2)  Criticize  the  new  oian,  performing  anv 
necessary  reordering  o.r  elimination  of 
redundant  operations. 


Clearly,  tnls  aiaorlthm  Is  an 
oversimplification,  hut  for  the  purposes  of  this  report  we  may 
imanlne  that  the  Planning  process  continues  until  no  new  details  are 
uncovered.  (In  tact,  tor  the  complete  proolem  solvino  and  execution 
monitoring  system,  a  local  decision  must  be  made  at  every  node  about 
Whether  it  should  be  expanded.) 

A  detailed  example  of  the  generation  of  a 
plan  tor  assembling  a  disassembled  air  compressor  is  presented  in 
Section  11. H, 4. 

A  recent  paper  [23]  discusses  in  more  detail 
the  problem  solving  algorithms,  the  constructive  critics,  and  a 
comparison  of  this  approach  with  other  recent  work, 

n.  The  Kxecution  Algorithm 

The  output  ot  the  planning  process  is  a 
procedural  net,  wnlcn  was  developed  as  a  hierarchy  of  partially 
linearized  plans,  tlgure  6(a)  suggests  the  planner's  viewpoint  of  the 
procedural  net.  The  same  procedural  net  is  also  the  Input  to  the 
execution  portion  of  the  system,  ihe  execution  algorithm  views  the 
net  differently,  however,  it  sees  the  procedural  n^t  as  a  collection 
of  action  hierarchies,  as  suggested  by  Figure  6(b).  An  action 


hierarchy,  consisting  ot  a  node  representing  an  action,  together  with 
its  children  nodes  representing  supactlons,  together  with  tn^lr 
descendent  nodes,  will  be  termed  a  wedge,  Tne  execution  monitor 
views  the  procedural  net  as  a  sinaie  i^edge,  to  which  it  applies  the 
following  digorlthm: 

(1)  Ask  the  apprentice  to  accomplish  tne 
action  represented  by  the  node  at  the  top 
of  the  wedge.  This  Is  done  by  saying  the 
node's  query  to  hi n , 

(2)  It  he  responds  Positively,  assume  the 
current  wedge  has  been  accomplished,  and 
so  assume  the  current  wedge  has  been 
successfuly  executed. 

(i)  If  he  responds  negatively,  assume  he 
neeas  a  more  detailed  breakdown  of  the 
action,  and  so  execute  in  turn  all  the 
subwedges  headed  by  children  of  the 
current  wedge. 

Actually,  the  algorithm  Is  more  complicated 
than  this.  The  apprentice  may  make  a  wider  variety  of  responses.  To 
each  guery,  his  possible  responses  are; 
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Affirmative  responses 


Yes,  OK,  Yup,  Check. ,, 


This  type  of  response  Indicates  tnat 
tne  jpprentlce  understands  the 
Instruction  and  is  able  to  do  it. 

In  fact,  in  the  current  implementation 
the  cnc  proqram  assumes  that  the  task 
has  oeen  completed.  This  type  of 
response  slqnais  the  execution 
alaorlthm  to  move  on  to  the  succeeding 
wedge . 

Negative  responses  -  no,  How,  Can't... 

Tnls  type  of  response  indicates  that 
the  apprentice  needs  help  before  he 
can  perform  the  indicated  action. 

This  signals  the  procedural  net 
program  to  move  to  the  first  child 
node . 

Repeat  responses  -  what,  Huh... 

This  type  of  response  indicates  that 
the  apprentice  did  not  hear  the 
instruction  or  was  not  sure  what  was 
said.  Please  repeat.  The  program 
merely  repeats  the  query. 


Motivation  response  -  wny 


The  apprentice  vants  to  icnow  why  a 
certain  task  needs  to  oe  done.  The 
current  response  to  this  question  is 
for  the  procedural  net  program  to  list 
the  tasKs  that  remain  to  be  done  at 
that  level.  These  corresoond  to  the 
queries  of  successive  nodes  that  tiave 
the  same  parent  as  the  current  node. 

If  the  apprentice  still  wants  to  Know 
Why,  the  program  then  repeats  the  query 
associated  with  the  parent  nooe.  This 
process  may  be  repeated  until  there  are 
no  more  parent  nodes, 

tscape  responses  -  hreax,  Pause#  Graphics, ., 

These  responses  are  temporary  expedients 
to  allow  interaction  with  other  portions 
of  the  CBC  system#  such  as  the  graphics 
pacxage.  (See  the  description  of  the 
CBC  fcxpert  system  in  Section  II, F  below). 
This  allows  the  apprentice  the  opportunity 
to  asK  questions  like  "where#"  "wnat  is 
this#"  and  the-  like, 

When  the  top  wedge  of  tne  procedural  net  has 
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been  successfully  executed,  the  Execution  Phase  terminates  with 
"Thank  You". 


The  current  system's  ability  to  monitor  the 
execution  of  a  "ask  is  limited,  and  Its  ability  to  respond 


Intelllqently  to  unexpected  failures  Is  nil.  During  the  coming  year 
we  plan  to  focus  considerably  more  energy  on  the  execution  monitoring 


aspect  of  the  assembly/disassembly  task. 


The  Semantics  of  Assembly  and  Disassembly  Actions 


Relations 


In  order  to  model  the  processes  of  assembling 
and  disassembling  equipment,  we  have  defined  a  set  of  entitles  and 
relations  that  are  used  to  describe  a  device  In  arbitrary  stages  of 
assembly  and  disassembly.  The  definitions  being  used  In  the  current 


system  are  given  In  this  section  along  with  examples  that  relate  to 
the  air  compressor.  These  definitions  form  the  basis  for  the  aoUP 


functions  that  produce  a  procedural  net  of  Plans  for  assembly  and 
disassembly.  The  SOUP  functions  will  be  described  In  Section 
II.B.3,b. 


Connections 


A  "connection"  Is  defined  between  any 
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t^o  components  that  are  fastened  to  each  other  ^nen  a  device  is  tullv 


assembled.  fhe  elements  of  a  connection  are  an  ordered  pair  of 
components,  wnere  the  orderinq  Implies  that  tne  first  component  is 
fastened  to  the  second  component,  for  example,  we  have  (Ct)t.Nb:CT10N 
PUMP  pLATfOKM)  rather  than  (CCUiNfC ri Lid  pLAlfOHM  PUMP),  since  one 
would  say  "Connect  the  pump  to  the  olatform"  rather  than  "Connect  the 
Platform  to  the  pump".  In  the  cases  where  no  Intuitive  or  actual 
assymetry  exists  between  tne  components,  we  determine  whether  one  of 
the  components  supports  the  other  In  the  fully  assembled  device.  if 
so,  the  supportee  Is  the  first  element  of  the  Pair.  In  the 
remaining  cases,  where  neither  criterion  applies,  an  arbitrary 
ordering  of  the  components  is  chosen. 

The  connection  relations  are  used  for 
defining  the  canonical  locations  of  components  for  tne  fuiiy 
assembled  device,  rather  than  for  speclfyino  actual  locations  of 
components  at  any  Particular  time.  Thus,  connection  relations  remain 
unchanged  during  aasemoly  and  disassembly. 

ill  Fastenings 

Connections  usurlly  represent 
components  that  are  fastened  together  ny  boltsr  screws,  machine 
screws,  or  setscrews.  The  objects  that  fasten  components  together 
are  referred  to  as  "fastenings".  A  bolt  with  Its  nut  and  washers  Is  a 
standard  type  of  fastening.  Examples  of  fastenings  Include  each  of 
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the  toor  nut-washer-t  ol  t  asseinblies  tnat  connect  the  pump  to  tho 
Platform  and  each  of  the  ten  sheet  metal  screws  that  fasten  the  belt 
housinq  cover  to  the  frame. 


The  association  between  a  fastenlnq 


and  the  components  it  fastens  Is  represented  by  storing  with  each 
connection  the  fastenlnas  that  hold  it  together.  Table  1  lists  some 
of  thp  connections  and  fastenings  that  are  currently  used  by  the  CHC 


system 


Table  1:  CUNNLCTIOW  Expressions  for  the  Air  Compressor 


(CONNECTION  fumP  Platform) 


FASTENF'NsbOLTON 


EASTEN1NG=(»BciLT  Pumpbase  Platform  -WASHEH  .NUT) 
LE’NCTH=1  ,25 
diameters, 3125 
NllMbEH  =  4 


(CONNECTION  Motor  Platform) 


FASTENFNsbOLTON 


FASlENINGs(_BOLT  Motorbase  Platform  -WASHER  -NUT) 


LENGTHsl 


DIAMETER  s,25 


NUMbER=4 


.•  v  -  •'  •  ■ 


(CQfJNtCTlON  Pumppulley  pump) 
f  ASTENFNrwHFJLLClN 

F  ASTEM  NG=  C^SFTiiC  PUmppuiley  PumDSh-ift) 
LENGTHS . 2b 
niAMt:TEH=.:>5 
NUMbF.P  =  2 

(CONNECTION  Motorpuiley  Motor) 

F  ASTENF' NsWHEELLiN 

F  AS  TEN  1 1'IGs  f.SETSC  REw  Motorpuiley  Motorsnatt) 
LF’.NGTHs  .  2b 
DIAMETERS. 25 
N  UMF^ERsl 

(CONNECTION  Belt  pumppulley) 

F  ASTENF'NsRELTON 

(CONNECTION  belt  Motorpuiley) 

F  ASTENFNsHELTON 

(CONNECTION  F'^umPbrace  F’ump) 

F  ASTENFNsHOLTON 

FASTEnInGs(_BuLT  Pumpbrace  Pumptop) 

LENGTHS  .75 
DIAMETERS. 3 125 

F  UMhF'Rsl 
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(CONNECTION  Pumpbrace  belthousinqtrame) 

F  ASTPNF  N  =  SCHEWON 

FASTENINGS («SCPEW  PumDbrace  DeithoUainqtrairte ) 

LENGTHS, 5 

DIAMETERS, 25 
NUMBER=2 

(CONNECTION  Belthouslnqcover  Be  1 thous inatrame ) 
FASTENF'NsSCRLt^ON 

FASTLNlNGs(_sCREi/^  Be  1 1 hou s ingco ver  Beithous inqf rame ) 
LENGTHS.  5 
DIAMEiEHs,2b 
NllMBERslO 

(CONNECTION  Aftercooler  Pump) 

FASTENFNsSCHEWIimTU 
FEMALEsPUmP 
MALF.sAf  tercooler 

(CONNECTION  Attercooler  Attercoolereldow) 

FASTENFNsSCRErtiNTO 

FEMALEsAf tercooler 
MALEsAtti-rcoolerelbow 


Ill)  Chunics 


Ta/o  components  x  and  y  nave  a 
connection  path  detlned  oetween  them  It  there  exists  some  sequence  ot 
connections  betwten  components  X-ci,  Cl-C2»  CN-Y.  A  ’’Chunk"  Is 
a  collection  of  components  that  have  connection  paths  defined  amon'^ 
them  and  are  all  positioned  with  resoect  to  each  other;  i.e.,  a 
positioned  supasrembly,  we  define  tne  "loose  ends"  of  a  chunk  to  be 
that  colleci. ion  of  connection  relations  between  mempers  of  the  chunk 
and  nonmeirhers  of  the  chunk.  For  example,  an  Isolated  single 
component  can  be  considered  a  chunk  and  all  the  component's 
connections  would  he  considered  loose  ends.  If  a  chunk  is  positioned 
with  respect  to  some  other  chunk,  then  the  loose  ends  set  of  the 
newly  formed  (larger)  cnunk  consists  of  those  connections  that  were 
elements  of  exactly  one  of  the  loose  ends  sets  of  the  two  old  chunks 
(since  connections  that  were  loose  ends  of  both  the  old  chunks  are 
now  connections  between  members  of  the  new  chunk.) 


Fastened/Unfastened 


If  ^  is  a  fastening,  then  the 
relation  (FASTENED  X)  is  true  whenever  X  has  been  inserted  in  its 
proper  place  and  tightened.  For  example,  a  fastened  nut  and  oolt 


V'.-  V  -.'  0  - 
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assembly  means  that  the  bolt#  nut#  and  all  associated  washers  are 
firmly  In  place.  Similarly#  (UNFASTENED  X)  is  true  when  the  fastenlnu 
X  Is  disassembled  and  removed  frcm  Its  proper  position. 


V)  Positloneri/Extracted 

If  components  X  and  i  have  a 
connection  defined  between  them#  then  tne  relation  (POSITIONED  X  Y) 
Is  true  whenever  X  and  y  are  In  the  same  chunk.  Similarly#  If 
components  X  and  Y  have  a  connection  defined  oetween  them#  then  the 
relation  (EXTRACTED  x  Y)  Is  true  whenever  X  and  Y  are  In  different 
Chunks  and  X  and  Y  do  not  restrict  each  other's  movement  In  any 
meanlnofui  way. 


Chunk  descriptions  and  the  relations 
POSITIONED  and  EXTRACTED  are  redundant#  since  being  a  loose  end 
implies  EXTRACTED  and  not  being  a  loose  end  Implies  POSITIONED, 

It  Is  convenient  to  define  the 
relational  form  (POSITIONED  X)  to  be  true  for  a  component  X  if  and 
only  it  (POSITIONED  X  Y)  Is  true  for  each  Y  such  that  (CONNECTION  x 
Y)  Is  defined.  Similarly#  (EXTRACTED  X)  is  defined  to  be  true  for  a 
component  X  It  and  only  If  (EXTRACTED  X  Y)  Is  true  for  each  Y  such 
that  (CONNECTION  X  Y)  Is  dellned. 

vl)  Attached/Detached 

If  (CONNECTION  X  Y)  is  defined#  then 
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the  relation  (ATTACHhD  X  If)  is  true  wrenever  (FaSFFJNED  is  true  for 

ail  fasteninas  Z  associated  wltn  the  X-Y  connection.  (Note  that 

ATTACHEU  and  FASTENED  can  only  oe  tru?  it  PiiSiTluwfcn  is  also  true.) 

Similarly,  it  icnrihECTlON  x  Y)  is  detined,  then  the  relation 

(OETAChED  X  Is  true  whenever  (UNFASTENED  z)  is  true  tor  all 

tastenlnqs  Z  associated  with  the  X-Y  connection. 

wie  also  define  tne  relational  torm 
(attached  X)  to  be  true  tor  a  component  X  it  and  only  if  (ATTACHED  X 
Y)  IS  true  tor  each  Y  such  that  (CONNECTION  x  Y)  is  defined. 
Similarly,  (DETACHED  X)  is  oetined  to  be  true  for  a  component  X  if 
only  if  (DETACHED  X  Y)  is  true  for  each  Y  such  that  (CONNECTION  X 
Y)  is  defined, 

vii)  Connected/Disconnected 

For  any  comoonerts  X  and  Y,  the 
relation  (CONNECTED  X  1)  is  true  whenever  (ATTACHED  X  Y)  is  true,  and 
the  relation  (DISCONNECTED  X  Y)  is  true  whenever  (EXTHACTED  X  f)  is 
true.  (Note  that  ATTACHED  implies  POSITIONED  and  EXTRACTED  implies 
DETACHED, ) 

We  also  define  the  relational  form 
(CONNECTED  X)  to  he  true  for  a  component  X  if  and  only  if  (CONNECTED 
X  Y)  is  true  for  each  Y  such  that  (CONNECTION  x  Y)  is  defined. 
Similarly,  (DISCONNECTED  .:)  is  defined  to  be  true  for  a  component  X 
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we  also  define  tne  relational  torm 
( l.'j.sTALLKl)  *)  to  re  true  tor  a  component  X  it  and  only  If  (lNSTAL,ttU 
X  t)  Is  true  for  each  i  such  that  (CU'^fNiiCTlO  4  x  Y)  is  defined. 
Similarly#  iwtviiViJ-.n  X)  is  defined  to  oe  true  for  a  component  X  If  and 
only  It  (KKiiuvfcO  <  Y)  Is  true  for  eacn  ^  such  that  (CQNUtCTlON  X  Y) 
Is  defined. 

Iv)  Assemoied/Dlsassembied 


Kor  any  device  X,  tne  relation 
( Aist^’bi.tn  X)  is  true  Whenever  ( 1  .«ST ALUtu  Y)  Is  true  for  each 

component  Y  of  X,  Similarly#  tor  any  device  X,  the  relation 

(0 rsASSf.httLtt  X)  IS  tru»  wnenever  (kKmdvKu  Y)  Is  true  tor  each 

component  Y  of  X, 
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X  ) 


It  X  Is  a  co^nponent  of  a  fastening  or 
Is  a  tool,  then  the  relation  (ONHAND  <ob1ect-tVDe  ot  X>  X)  is  true 
whenever  X  is  in  use  by  or  Immediateiv  available  to  the  technician. 
This  relation  is  typically  used  for  objects  such  as  scr-'ws,  oolts, 
nuts,  washers,  setscrews,  wrenches,  or  screwdrivers. 


XI  ) 


Startedin/laKenout 


It  X  is  a  fastening,  then  (STARTKOIN 
X)  is  true  whenever  the  components  of  X  have  been  positioned  with 
respect  to  the  connection  thc.t  they  fasten.  Similarly,  if  X  is  a 
fastening,  then  (TAKfc.MGUT  X)  is  true  whenever  the  components  of  X 
have  been  removed  from  the  connection  that  they  fasten. 


xi  i ) 


Tightened/Loosened 


If  X  is  a  fastening,  then  (TIGHTENED 
X)  is  true  whenever  the  components  of  X  have  been  tightened.  For 
example,  a  bolt-washer -nut  fastening  is  tightened  by  turning  the  nut 
onto  the  bolt  until  tight.  Similarly,  (loosened  X)  is  true  whenever 
the  components  of  a  fastening  are  loosened.  The  relations 
STARTEDIN/TAKENOUT  and  T IGHTENED/LDOSENEO  for  fastenings  are 
analogous  to  the  relations  PGS IT IQNto/t XTRACTED  and 
CONNLCTF.D/DISCUNNLCTEO  for  components. 
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Spindled 


Si^li^DLLD  Is  a  relation  that  applies 
to  a  fastenina  and  a  list  of  components,  Tne  SPINDLLU  relation*  If 
true*  implies  that  the  objects  are  fastened  together  In  the  order 
listed  in  the  relation.  An  example  is  (SPINRLtD  boltl  Pump  Platform 
washerl  Nutl),  This  type  of  relation  Is  used  to  keep  track  of 
associations  between  particular  bolts*  nuts,  washers,  and  the  like. 

xiv)  Applied 

The  relation  (APPLIKU  <tool-tYPe> 
<f astenlng-name> 1  is  true  whenever  a  tool  of  the  specified  type  Is 
belno  used  by  the  apprentice  to  tighten  or  loosen  the  specified 
fastenina. 


b.  Describing  Actions  for  Assembly  and 

Disassembly 

The  relations  described  In  the  preceedlng 

section  imply  a  hierarchy  of  actions  to  be  used  in  forming  plans 

about  assembly  and  disassembly  of  equipment,  Accordlnaly,  SOUP 

functions  pave  been  written  to  achieve  all  tne  relations*  referring 
explicitly  to  tools  and  fastenings  when  appropriate. 
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Flaijres  7  and  8  snow  the  relatlons/actlors 
hierarchy  tor  assenioiy  and  disassembly  planning.  The  upper  case 
names  refer  to  relations;  the  actions,  or  SOUP  functions 
corresponding  to  those  relations*  are  lower  case  names.  Tfie  vertical 
lines  connecting  the  blocks  in  tne  figures  indicate  different  levels 
of  the  hierarchy,  and  Imply  function  calls.  wnen  a  SOUP  function 
calls  more  than  one  lower  level  SOUP  function,  tnls  is  indicated  by  a 
horizontal  line.  Some  of  the  assembly  actions  are  described  below. 

ilSSFMPLK  (ULAMBDA  (  ASSFMBLFiJ  -OBJ) 

(APPLY  (FUNCTION  PANH) 

(MAPCAH  (GtTp  $ObJ  (JUOTE  CUMPONENfS)) 

(FUNCTION  (LAMBDA  (K) 

(t(‘-'l,OAL  (INSTALL  ( >«  X)) 

(INSTALLED  X)) 

APPLl  (INSIALLOBJ) ) ) J 

A  list  of  Ci'MpONENTS  has  been  previously  set  up.  To  assemble  the 
object,  set  up  a  goal  for  Installing  each  component  separately,  if 
any  component  Is  already  Installed,  this  Information  win  be  already 
stored  in  the  world  model,  pGOAi.  will  discover  this  tact,  a  PHANTOM 
node  will  be  Inserted  In  the  net,  and  the  apprentice  will  never  be 
Instructed  to  Install  a  component  unnecessarily. 


DIASSEMBLED 

unassemble 


REMOVED 

uninstallobj 


DISCONNECTED 

unconnectobj 


DETACHED 

imbelton 

unbolton 

unscrewinto 

unscrewon 

unweldon 

unwheelon 


EXTRACTED 

unpositionobj 


UNFASTENED 

unfastenobj 


LOOSENED 

untightenbolt 

untightenmachinescrew 

untightenscrew 

untightensetscrew 


TAKENOUT 


ONHAND 

lookforobj 


lookfor- 

substltuteobj 


APPLIED 

useallenwrench 

usescrewdriver 

usewrench 
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FIGURE  8  FLOW  CHART  FOR  SOUP  FUNCTIONS  IN  THE  DISASSEMBLY  DOMAIN 


. -V  *.\'k 


INSTALLOBJ  (OLAMBDA  (INSTALLED  *-UriJ) 

(UPROG  (-OBJ21 

(APPLY  (FUNCTION  PAi’^D) 

(MAPCAH  (CUP  (INSTANCFJS 

(CONNECTION  SUB  J  ^UBJ2n) 

(FUNCnUN  (LAMBDA  (X) 

(SETQ  X  (CADDR  X)5 

(t(PGUAL  (CONNECT  $UHJ  TO  (@  X)) 

(CONNECTED  SOBJ  (^  X)) 

APPLY  (CUNNECTDBJ  )  )  )  ] 

Each  defined  connection  relation  is  explicitly  stored  In  the  world 
model.  The  QLISP  function,  INSTANCES,  will  retrieve  all  those 
connections  that  Involve  $OBJ.  Then  a  qoal  Is  set  up  to  connect 
$OBJ  to  ail  other  components.  Notice  that  the  P-fUnctionr  PAND,  is 
used  to  make  a  conjunction  of  all  the  connections;  the  procedural  net 
critiques  will  put  the  conjuncts  In  the  best  order  for  execution. 

CONNECTUBJ  (ULAMBDA  (CONNECTED  »- MBJl  -OHJ2) 

(PGCIAL  (PUSITIOM  SUBJJ  UN  $OBJ2) 

(POSITIONED  SOBJl  $OBJ2) 

APPLY  (POSITIONUBJ)  ) 

(PGOAL  (ATTACH  $OBJl  TO  $OBJ2) 

(ATTACHED  SOBJl  SOBJ2) 

APPLY  ((|i(OGET  (CUNNECIION  $0HJ1  SQBJ2)  FASTENFN )  )  )  )  J 


and 


In  order  to  connect  two  objects,  they  tnust  first  be  positioned, 
then  attached  to  each  other.  The  type  of  attachment  Is  implied  by 
the  fastenlnq  function  property,  KASTEimkk,  stored  on  each  connection 
relation , 

POSITIONCSJ  (QLAMbDA  (  PUS  1 T  I  ON  ED  OB  J  1  ^  Ub  J2  ) 

(OPPOG  (-MUBJ  -  FOBJ) 

(SELECTQ  (UGLT  (CONNECTION  $0001  SUbJ/t)  FASTENFN) 

(wHEEIjON  (PGOAFj  (PLACE.  THE  SUBJl  UM  TmF  SUBJ2 

SHAFT  IN  SUCH  A  WAY  THAT  THE 
FLAT  SIDE  OF  THE  SHAFT  IS  ALIGNED 
WITH  THE  FLAT  PART  INSIDE  THE 
center  hole  of  THE  SOBJl  AND  THEN 
PUSH  THE  SOBJl  UNTO  THE  S0BJ2 
SHAFT  AS  FAR  AS  YOU  CAN) 

(POSITIONED  SOBJl  S0BJ2) 

APPLY  ML)) 

(BELT(JN  (PGOAL  (POSIfIJN  sOHJl  JN  GROOVE  OF  sDhJ2) 

(POSITIONED  SOBJl  sabJ2) 

APPLY  (I  XPLA INBELTPnsiT  IOn  )  )  ) 
(SCPEwlNTO  (OGET  (CONNECTION  sObJl  $0602) 

FEMALE  ^FOBJ  MALE-MOBJ) 

(PGOAL  (PLACE  THE  END  OF-  THE  SMOBJ 
NEXT  rU  THE  HOLE  Ol-  THE  $FOBJ) 
(POSITIONED  $UBJ1  $0BJ2) 

APPLY  ML)) 
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(PGUAL  (PLACE  THE  $OBJl  AND  THE  S0BJ2  NEXT  TCI  EACH 
OTHER  IN  bllCH  A  WAY  THAT  HOLES  IN  THE  SUHJl 
ARE  MATCHED  UP  WIH  HOLES  IN  THE  SC)BJ2) 
apply  ML)))] 

This  Is  a  general  positioning  function  that  gives  instructions  about 
four  different  types  of  Posltlonlngs :  Wheels#  belts,  components  that 
screw  into  other  components,  and,  finally,  components  tnat  are 
connected  with  fastenings  such  as  bolts,  or  screws. 

BOLTON  (QLAMBOA  (ATTACHED  ^.UBJl  ^OHJ2) 

CPGOAL  (USE  BOLTS  I’U  CONNECT  $UbJl  AND  $0BJ2) 

(FASTENED  BOLT  (SOBJl  $fjBJ2)) 

APPLY  (FASTENOBO))) 

This  is  an  example  of  an  attachment  function,  applying  to  components 
that  are  to  be  bolted  together. 

FASTENOBJ  (ULAMBDA  (FASTENED  -FASTENING  (-OH J 1  -  OB J 2 )  ) 

(OPRUG  (-objects  -  LENGTH  -N  -DIAMETER  -C 
-COMPUTATION  -VARIABLES 

(-FASTENINGS  (MKATOM  (CQNCAT  $FASTENING  "S")))) 

(OGET  (CONNECTION  SOBJI  SOBJ2) 

FASTENING  -OBJECTS  LENGTH  -LENGTH 
NUMBER  -  N  SHAPE  -SHAPE  DIAMETER  -  DIAMETER ) 

(COND  ((EQ  $N  1)(MATCHQ  -FASTENINGS  pl-'ASTEN  I NG )  )  ) 


(We  hdve  omitted  a  section  of  code  nere  that  sets  SVARIABLFS 
equal  to  tne  list  of  variables  in  $C)BJECTS.  These 
are  the  bolts»  washers»  nuts#  screws#  etc.,  which 
are  not  explicitly  specified  by  name.  The  code 
constructs  a  query  of  the  form  "qet  two  #3  holts  and 
two  #4  washers  and  two  #3  nuts"  to  be  used  in  the 
subsequent  PBUILU  statement.  This  special  query  Is 
saved  as  the  value  of  sCOMPUTATluN . ) 

(PBUILD  {CLASS  --C) 

(GET  (!  (@  (CDR  (APPLY  (Fl)NCTIU.'J  APPEND) 

$C(J»1PU  FA  riON  )  )  )  )  ) 

(ITERATE  $N  $VAH1ABLES 

fMAP2C  SCOMPUTATION  SVARIARLES 
(FUNCTION  (LAMHuA  (X  Y) 

(PGOAL  (GET  ONE  (•  ('d  (CDDR  X)))) 

(QNUAJD  («  (MKCONsTANT  Y))  (fi  Y)) 

APPLY  (LUUKFUROBJ)  lYPE  { fi  (CDDR  X))))) 
(OPUT  (CONNECTION  SUBJl  $OBJ2)  HARDWARE  $C) 

(PBREAK  (CLASS --C) 

(LOOSELY  FASTEN  THE  S'!  SFASTENINGS) 

(ITERATE  $N  SVARIABLES 

(PGOAL  (START  IN  ONE  SFASTENING) 

(STARTEDIN  SFASTENING  (@(t  SVARIABLES))) 
APPLY  (STAR^In)) 

(MAPC  SVARIABLES  (FUNCTION  (LAMBDA  (V) 

(SETQ  V  (LIST  (QUOTE  UNHAND) 

(MKCONSTANT  V)  V)) 

(PDENY  (@  { t  (0  V)  ))))))) ) 
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(PBHLAK  (CLASS  -^C) 


(TIGHTEN  THE  SN  SFASTEMNGS) 

(ITERATE  $N  SVARIABLES 

(PGOAL  (TIGHTEN  UNE  $KASTEMNG  ) 

(TIGHTENED  $FASTEN1NG  ( P (  t  $  V AR 1 APLES  )  )  ) 
APPLK  (TIGHTENBOLT 

tightenmachinescrew 

TIGHTENSCHEa 
f IGHTENSETSCREW) ) ) ) J 


In  fastening  objects  together,  first  get  the  fastenings,  then  loosely 
fasten  them,  then  tighten  them.  The  initial  QGET  statement  retrieves 
the  properties  of  the  fasteninas  themselves  (length,  diameter, 
number,  and  so  on).  The  PBUILD  statement  instructs  the  apprentice  to 
physically  get  the  fastenings.  Tne  two  PBREAK  statements  tell  the 
aoprentice  what  to  do  with  the  fastenings  to  ma<e  the  connection. 


TIGHTENBOLT  (QLAMBDA  (TIGHTENED  BOLT  (-.BOLT  .-*-0)) 

(QPROG  (--.WRENCHl  -  WHENCH2  -  NUT  ) 

(COND  ((UR  (NULL  $0) 

(NUT  (EQ  (GETP  (MATCHQ-NUT  (FLAST  $0))  (QUOTE  TYPE)) 
(QUOTE  NUT))))) 

(PGOAL  (FIND  A  WRENCH  TO  FIT  THE  BOLT  HEAD) 

(ONHANO  rtKENCH  - WRENCH2) 

APPLY  (LOOKFOHOHJ)  TYPE  NRENCH) 


(PDENY  (OiMHAND  WRENCH  $WRENCH2)) 


(PGfJAl-  CUvSfc-  THF  WREMCH  TG  TURN  rHE  BULT 
CLOCKWISE  until  FAIRLY  TIGHT) 

(APPLIED  SWRENCH2  $BOLT) 

APPL\  (USEWHE  <iCH)  )  ) 

(T  (PGUAL  (FIND  A  WRENCH  TO  FIT  THE  NUT) 

(UNHA'ML  wrench  ^  WREnCHI  ) 

APPLY  (LUOKFORObJ)  TYPE  wRFNCH) 

(PUENY  (UNHAND  WRENCH  SWRENCHl)) 

(PGLIAL  (FIND  A  WRENCH  TO  FIT  THE  BOLT  HEAD) 

(UNHAND  WRENCH  -WRENCH2) 
apply  (liOOKFUROriJ)  TYPE  WRENCH) 

(PDENY  (ONHAwD  wREnCH  Sw’RENCri2)) 

(PGUAL  (USE  THE  FIRST  wRENCH  TO  HOLD  THE  NUT  FIRMLY) 
(APPLIED  $WHENCH1  $NUT) 

APPLY  (USEwHENCH)) 

f I  GOAL  (USE  THE  SECOND  WRENCH  TO  TURN  THE  BOLT 
CLOCKWISE  UNTIL  FAIRLY  TIGHT) 

(APPLIED  sWkENCH2  SBOLT) 
apply  (USEWRENCH)) 

(PASSEHT  (ONhAND  wrench  SWRENCHl)))) 

(PASSERT  (ONHAND  WRENCH  SWRENCH2))) 


inis  is  an  example  of  a  particular  tiahtenina  function, 
c  riGHTENSCRfc:w,  TlGHTtNMACHINESCRErf^l,  and  TIGHTENSETSCREW  are  Similar.) 
The  process  requires  the  apprentice  to  get  the  tools  and  use  them. 
While  the  tools  are  in  use,  they  are  declared  to  be  "unavailable"  by 
the  PDENY  statements.  They  are  later  made  available  again  oy 
PASSEHT. 


It  is  important  to  notice  that  none  of  the 
SOUP-f unctions  described  in  this  section  actually  refer  to  an  air 
compressor  in  any  way.  They  refer  to  members  of  a  COMPUNENTS  list 
and  to  a  set  of  CONNECTION  relations  that  are  stored  in  the  world 
model.  Tools  are  explicitly  referred  to  in  the  lower  level 
functions,  as  are  fastenings  such  as  screws,  nuts,  and  bolts. 


All  the  specific  informetion  about  the  air 
compressor  is  coded  into  a  single  initializing  function  that  sets  up 
the  world  model  before  any  of  the  procedural  net  is  built.  The 
initialization  function  contains  many  expressions  of  the  following 
f  orm : 


(ASSERT  (CONNECTION  PUMP  PLATFORM) 

FASTENFN  BOLTON 

FASTENING  (^BOLT  PUMPBASE  PLATFORM  *-WASHER  ^  NUT ) 
LENGTH  1,25 
DIAMETER  ,3125 
NUMBER  4) 


(Other  examples  were  shown  in  Table  1  above.) 


Thus  we  expect  that  It  would  be  relatively  easy  to 
convert  the  current  planning  and  execution  monitoring  program  to 
another  example  ot  electromechanical  equipment. 

4.  Examples  trom  a  Demonstration  System 

a.  A  Detailed  Trace  of  the  Planning  Algorithm 

The  NTiAH  system  is  Invoked  with  a  top-level 
goal  as  its  argument.  An  initial  procedural  net  is  hunt,  with  the 
structure  shown  in  Figure  <5(a).  Tne  body  of  the  (TQAL  node  Is  the 
vaiue  of  a  OLISP  variaoie  that  is  bound  to  a  list  of  an  toP-leVel 
SOUP  functions  (in  this  case,  ASSEMBLE  and  D1 SASSEMBLE ) . 

The  planning  algorithm  is  then  applied  to  the 
most  detailed  plan  in  the  Initial  net.  At  this  point,  the  most 
detailed  plan  consists  ot  the  single  GOAL  node.  Tne  GOAL  node  Is 
simulated,  wnich  means  that  the  functions  in  Its  body,  namely 
ASSEMBLE  and  DISASSEMBLE*  are  applied  in  turn  to  Its  pattern 
(ASSEMBLED  AlHCOMPHESSUR )  Until  Some  function  does  not  fall,  (Note 
that  this  Is  essentially  equivalent  to  evaluating  the  Ql.ISP  statement 
(GOAL  (ASSEMBLED  A I RC UMPRESSUR 1  APPLY  (ASSEMBLE  DISASSEMBLE)).) 

The  function  ASSEMBLE  was  reproduced  In 


(b) 
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FIGURE  9  PROCEDURAL  NET  OF  THE  DEMONSTRATION  SYSTEM 


Section  3  anove.  It  evaluates  the  exoresslon  (P(jL)AL  (Install 
COMP-i)  (INSTALLED  COMP-l )  APPLY  ( 1 NST ALLObJ ) )  ,,,  (PGOAL  (Install 
COMP-n )( INSTALLED  COMP-nl  APPLY  (  I  Ns'f  ALLf'rtJ  )  )  ) ,  for  components  COMP-1 
through  COHP-n  of  the  air  compressor.  Evaluation  of  the  PAND 
statement  results  In  the  evaluation  of  each  of  the  P(.OAL  statements. 
When  each  PGOAL  statement  Is  evaluatei,  the  expression  (INSTALLED 
COMP-i)  is  asserted  in  the  current  wjrH  model,  and  a  new  node  is 
placed  In  the  procedural  net.  The  new  node  will  nave  (INSfALLED 
COMP-i)  as  Its  pattern,  and  wm  nave  (INSTALLOdJ)  as  its  body, 

Because  the  PGOALs  are  lnsJ.de  a  PAND 
statement,  the  nodes  that  tney  generate  In  the  procedural  net  are  not 
linked  linearly.  Rather,  they  are  linked  In  Parallel  to  special  SPLIT 
and  JOIN  nodes,  as  depicted  In  figure  9(b).  rhls  completes  the 
simulation  of  this  level  of  the  Plan, 

At  tnis  level  the  critics  do  not  yet  have  a 
sufficiently  detailed  model  to  analyze,  ano  so  they  propose  no 
alterations  to  the  Plan, 

Next  the  new,  more  detailed  plan  is 
simulated.  This  mpars  that  each  of  Its  nodes,  In  turn,  win  be 
simulated,  Flr.st,  the  SPLIT  node  Is  simulated,  and  this  results  In 
the  creation  of  a  new  SPLIT  node  at  a  lower  level  of  the  procedural 
net.  Then,  each  of  the  GOAL  nodes  is  simulated,  by  applylna  the 
function  INSTaLLOHJ  to  Its  pattern,  INSTaLLOBJ  con'alns  a  pAhD 
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statement.  csee  Section  3  above) 


Each  application  of  INSTALLOBJ 


represents  the  installation  o‘f  a  particular  component.  Evaluation  of 
the  PANL  statement  in  r'^TALLOHJ  win  result  in  the  generation  of  a 
parallel  qro"p  ot  GOAL  nodes  sp.cifylnq  all  the  connections  to  be 
made  to  the  ql^en  component  in  the  fully  assembled  air  compressor. 
Finally#  the  jniN  node  is  simulated#  resulting  in  the  creation  of  a 
new  JOIN  node.  The  new,  most  detailed  level  of  the  procedural  net 
looks  like  figure  ‘Jlc)  at  this  point.  Now#  it  preconditions  had  been 
defined  'or  each  connection,  the  critics  would  be  able  to  modify  this 
structuie  to  appear  as  in  Figure  9(d).  However,  the  preconditions 
have  rot  as  yet  been  encoded#  and  so  the  demonstration  system  relies 
on  the  intelligent  initial  orlerlnq  of  the  components  list  by  the 
detlner  of  the  domain.  The  critics  do#  however#  clean  up  any 
superfluous  SPLITS  and  JGlNs. 

Expansion  of  the  net  proceeds  in  this  manner# 
until  a  predetermined  depth  has  been  reached.  In  the  future  the 
depth  of  expansion  win  be  determined  by  a  model  of  the  apprentice's 
capabilities.  Further  expansion  can,  of  course,  occur  during 
execution  of  the  plan  if  the  apprentice  requires  more  detailed 


Instructions 


b.  A  Sample  Hialon 

A  samole  dialog  was  nlven  In  Section  I.B.3 
above.  It  exhibited  an  Interaction  oetween  the  CBC  expert  (FJ)  and  ';ne 
apprentice  (Al  and  contained  a  few  annotai.lons  and  explanations  of 
the  Interaction,  This  type  of  dialog  is  produced  from  the  execution 
of  a  previously-constructed  procedural  net,  although  it  is  possible 
to  have  the  net  constructed  "In  real  time"  as  the  apprentice  gives 
answers  to  the  Instructions  of  the  expert,  A  given  procedural  net  can 
produce  many  variations  of  dialog  according  to  the  level  of 
experience  of  the  apprentice.  This  makes  It  a  powerful  base  on  which 
to  build  the  rest  of  tne  system's  capaomties,  as  wm  be  described 
In  succeeding  sections  of  this  report, 

C.  A  Geometric  Model  Used  for  Pointing  In  the  CPC  Prole.'t 

t.  Introduction 

We  have  d»»vlsed  a  method  of  computer  modeling  of  the 
shapes  of  mechanical  parts  and  assemblies,  and  we  have  devised  a 
number  of  algorithms  for  manipulating  the  models.  These  have  been 
Incorporated  Into  a  demonstration  nroaram  modeling  the  air 
compressor.  The  program  constructs  models  of  the  compressor  from 
symbolic  descriptions,  displays  an  Image  In  Perspective,  and  mav  be 
used  to  Identify  or  point  to  various  parts  of  the  compressor,  by 
means  of  a  television  camera  anl  laser  Pointer, 


The  roiT'puter  representation  of  ron^plex  assemblies  Is 


built  from  primitive  solMs  (cubes,  we^aes,  an^  cylinders.)  In  this 
resnert,  the  models  are  similar  to  those  described  bv  ('raid  (241  and 
others  [2S,  2f'].  The  principal  character  1  s 1 1  cs  which  we  believe  to 
be  unique  In  this  Implementation  are  the  use  of  symbolic  "attachment 
Points"  to  specify  the  relative  positions  of  Parts  with  resoect  to 
one  another,  and  the  retalnlnq  of  symbolic  and  descriptive 
Information  alone  with  purelv  oeomet r Ic  information, 

We  use  the  nodels  In  the  followlnq  ways:  An 
apprentice  may  "point  to"  various  parts  of  the  compressor  hy  toucnlno 
that  part  with  a  wand  with  a  small  llqht  hulb  at  Its  tlP.  The 
computer  responds  by  namina  the  part.  Alternatively,  the 
apprentice  may  ask  the  computer  to  aim  the  laser  pointer  at  a  named 
part , 


The  system  at  present  mav  be  described  as  "oraPhlrs 
oriented",  In  the  sense  that  It  Infers  appearances  from  qeometrlc 
models^  rather  than  In^errlnn  oeometrv  and  strurtume  from  appearances 
as  a  "vision  oriented"  system  would,  we  are  In  a  preliminary  phase  In 
the  development  of  the  modellno  capability.  As  we  qaln  experience, 
the  system  will  pe  extended  to  provide  a  basis  for  scene 
understanding  ip  the  workshop  domain,  and  to  do  aeometrlc  reasonino 
for  Dlannino  purposes. 
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The  denions  t  rat  I  Oh  system  consists  of  twn  modules  for 
"forks"  in  TFNFX  parlance),  one  ooeratlna  In  a  LISP  environment  and 
one  operatlpo  under  SAIL,  The  MSP  nortlon  mananes  symbolic 
descriptions  to  determine  the  structural  and  snatial  relations  amono 
parts.  The  Saii,  nortlon  keeps  the  snecltlc  oeometrlc  descriptions  and 
absolute  spatial  Positions,  and  also  contains  algorithms  for 
manlpulatlno  visible  outlines.  The  symho i  ic /s t r uct ur a ]  data 
structures  and  algorithms  ar#.  described  in  the  nevt  suhsectlm,  and 
the  qeometr Ic/spatlal  In  the  one  followino. 

7.  Symbolic  and  Structural  Models 

The  basic  unit  of  structure  in  our  modeling  system  is 
the  "part".  Descriptions  of  complex  objects  are  built  hierarchically 
from  simpler  oblects.  Thus  a  part  may  represent  somethlno  as  simple 
as  a  primitive  buiidlna  block,  or  as  complex  as  the  entire 
workstation.  Associated  with  each  part  are  a  number  of  properties 
that  describ**  its  structure  and  position,  and  define  attachment 
points  for  use  in  assembling  parts  Into  hither-level  assemblies. 

Two  kinds  of  parts  are  used.  "Model  parts"  make  use 
of  dummy  parameters  to  specify  their  yarlat  le  dimensions,  and  are 
usually  described  in  a  canonical  Position.  "Actual'  Parts"  are  conies 
of  model  parts  that  have  a  specific  position  and  orientation  in  space 
and  dummy  parameters  replaced  by  actual  numbers.  Model  parts  are 


cre^^tpd  bV  a  proarammer  or  designer  in  sneclfVinq  a  Piece  of 


eoiilpnient;  actual  oarts  are  created  by  the  nroararr,  in  either  case, 
all  Information  about  a  oart  Is  carried  on  the  property  list  of  the 
LISP  atorr.  representlno  the  part. 

The  system  is  best  described  by  example.  Consider 
the  description  of  the  air  compressor's  oumn.  For  the  purposes  of 
qeometrlc  modellno,  the  pump  Is  modeled  as  two  rectilinear  niocks 
staci^ed  as  shown  in  Ploure  th.  The  model  cart  pump  contains  on  its 
property  list  thr  followinq: 

stpuctupr: 

[(Cramkcasf:  (rrick  5.0  3.5  5.511 

(PISTnM-CYMNPFR  (HRfCK  3.1  3,1  5.01  (RFF  CRANKCASE  T0P)1] 

This  description  says  that  the  pump  is  the  union  of 
two  simpler  parts.  The  first  item  in  each  sub’ist  is  a  symbolic  name 
to  be  used  within  the  context  of  the  nuno  to  refer  to  the  subparts. 
The  two  subParts  of  the  pump  are  assiqned  the  symbolic  names 
CRANKCASF  and  P I STON -C YL 1 MPEp ^  The  second  item  In  each  suhllst 
describes  how  to  build  each  suhpart.  The  CRANxcasf  is  to  be  modeled 
as  a  brick  of  dimensions  5,0  x  3.5  x  5.5  Inches  and  the 
PISTDN-CYLINDEK  as  a  hrlck  of  dimensions  3.1  x  3,1  x  5.0  Inches. 

The  remainder  cf  each  suhllst  tells  how  the  subparts 
are  to  be  Positioned  within  the  assembly.  Since  the  crankcase 
description  contains  no  explicit  position.  the  location  of  the 
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FIGURE  10  GEOMETRIC  MODEL  OF  PUMP 
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crankcase  Is  the  sa^ne  as  the  location  of  the  oumo  Itself.  The 
location  Information  for  the  PI STOM-CYT, imdFP  states  that  It  is  to  be 
placed  at  the  top  of  the  crankcase.  To  find  the  definition  of  "too"» 
It  is  necessarv  tp  examine  the  description  of  bHlCK,  The  complete 
description  of  BRICK  Is  as  follovks: 

stpuctupf  primitive 

PARAMLTEPS  (WIOTH  PF.PTH  HFir.HTl 

ATTACHMENTPniNTS 

ffBASF  (MTRSP  0  0  (MINUS  (EQUOTIEMT  HFIGMT  ? )  I  )  I 
(TOP  (MTRSP  0  0  (FOUOTIENT  MFIGHT  ?))) 

(BACK  (MTRSP  0  (FO'IdTTENT  DEPTH  0)  (MROT  "X"  -  90.1))))) 

The  attribute  PRIMITIVE  under  the  prooerty  STRUCTURE 
Implies  that  there  are  no  subparts  to  a  brick.  (There  exist  routines 
In  both  the  LISP  and  SAIL  proorams  for  deallna  oeometr leal ly  and 
spatially  with  bricks  and  other  primitive  parts.)  The  PARAf'RTERS  list 
contains  symbolic  names  for  the  brick's  dimensions^  which  are 
Indicated  In  Fiqure  11.  Finally,  attachment  Points  are  provided  for 
olaclnq  other  obiects  on  or  near  an  example  of  a  brick.  Since  our 
description  of  the  pump  depended  on  the  Top  of  a  brick,  let  us 
examine  Its  attachment  points  in  areater  detail. 

An  attachment  point  Is  a  rule  for  findino  a  specific 
point  on  the  surface  of  a  part  from  an  arbitrary  point  on  or  within 
the  part.  A  brick  is  defined  qeometr leal  1 y  In  the  SAIL  fork  in  a 


FIGURE  11  BRICK. 


canonical  r-osltion  and  orientation  centered  on  the  orioln  of 
coordinates.  Mowever,  It  Is  n-ore  convenient  ro  thlnic  of  the  location 
Of  a  brick  as  the  location  of  a  noint  on  which  the  orick  nav  he 
Placed.  The  HASK  attachTient  point  allows  us  to  perform  this 
transformation  automatically.  When  we  wish  to  specify  ;:hat  a  cube  of 
?  inches  Is  to  he  maced  op  a  table  ?o  Inches  off  the  floor,  the  hase 
attachment  point  tells  us  the  base  Is  located  HE  rr,MT/?  Cor  1  inchl 
below  the  cube's  center.  (The  function  ’^TRSP  reoresents  a  translation 
In  X,  V  and  z.)  Thus  the  center  Is  one  inch  above  the  tabletop,  or  31 
Inches  above  the  floor.  Furthermore,  the  ton  of  th.e  cube  Is  located 
one  Inch  above  the  cube's  center,  or  32  Inches  above  the  floor.  (When 
a  Dart  contains  no  explicit  HftSF.  attachment  point,  as  In  the  case  of 
the  pump,  the  null  transformation  Is  assumed.  The  BASE  of  the  pump  Is 
the  same  as  the  point  on  which  the  cPankcase:  is  to  be  placed.) 
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Ihe  attachment  point  BACK  Is  Interestinn  In  that  It 
Is  a  combination  of  two  primitive  transf ormat ions .  To  attach  a  oart 
to  the  bacK  of  a  brick,  must  first  moved  PK PTH/2  back  from  the 
brick's  center,  then  rotated  ho  decrees  about  the  x-axls  sc  that  Its 
base  may  rest  on  the  vertical  back  face  of  the  brick,  (The  function 
MROT  nenerates  a  rotation  about  an  axis.) 

A  fair  amount  of  ororesslno  is  necessarv  to  determine 
where  a  part  Is  to  be  placed.  Put  the  main  purpose  In  the  use  of 
attach m.ent  points  Is  that  once  thev  are  defined,  the  oroorammer  need 
not  be  aware  of  it.  He  need  only  specify  the  symbolic  name  of  an 
attachment  point  and  the  romrutatlon  proceeds  automatical ly. 

Parameters  have  not  been  well  exploited  In  our 
description  of  the  air  compressor.  uevertheless  we  expect  them  to 
be  Very  useful  when  we  model  to  a  areater  level  of  detail.  For 
example,  a  slnoie  structural  description  may  specify  a  generic  RULT, 
with  length,  diameter,  and  head  tvoe  to  be  supplied  In  each  specific 
Instance,  Washers,  nuts,  hearings,  shafts,  and  other  common  parts 
may  also  be  specified  In  this  wav. 

Using  the  mechanisms  described  above,  model 
descriptions  of  the  relevant  objects  In  the  workstation  may  be  built 
up.  Such  a  description  Is  shown  In  Flcures  l^fal  through  12(h), 


ROOM:  STRUCTURE  [  (TABLE  (TABLE) 

(MTRSP  6.0  30.0  0)) 
(COMPRESSOR  (COMPRESSORONBASE) 
(REF  TABLE  TOP))  ] 


TABLE:  STRUCTURE  [  (TABLE  (CYLINDER  ,7  54.0) 

(MTRSP  0  0  27.6)) 
(TURNTABLE  (CYLINDER  .7  36.0) 
(REF  TABLE  TOP) 

(MTRSP  0  0  .95))  ] 

ATTACHMENTPOINTS  [  (TOP  (REF  BASE  TOP))  ] 


(a)  ROOM 
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FIGURE  12  GEOMETRIC  MODEL  OF  WORKSTATION 


COMPRESSORONBASE: 

STRUCTURE  [  (COITRESSORBASE  (COMPRESSORBASE) ) 
(COMPRESSOR  (COMPRESSOR) 

(REF  COMPRESSORBASE  TOP))  ] 


COMPRESSORBASE: 

STRUCTURE  [  (BASE  (BRICK  31.625  15.0  1.5))  ] 
ATTACHMENTPOINTS 

[  (TOP  (REF  BASE  TOP))  ] 


COMPRESSOR: 

STRUCTURE  [  (TANK  (TANK)) 

(PUMP  (PUMP) 

(REF  TANK  PUMPPLACE)) 

(MOTOR  (MOTOR) 

(REF  TANK  MOTORPLACE)) 
(BELTHOUSINGFRAME  (BELTHOUSINGFRAME) 
(REF  TANK  PLATFORMBACK) ) 
(PRESSURESWITCH  (PRESSURESWITCH) 

(REF  TANK  PRESSURESWITCHPLACE) )  ] 


BELTHOUSING 

FRAME 
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FIGURE  12  GEOMETRIC  MODEL  OF  WORKSTATION  (Continued) 


STRUCTURE  [  (TANK  (hORIZONTALCYLINDER  26.0  12.4) 

(MTRSP  0  0  1.6)) 

(LEFTLEG  (BRICK  2.5  8.0  3.1) 

(MTRSP  -8.0  0  0)) 

(RIGHTLEG  (BRICK  2.5  8.0  3.1) 

(MTRSP  8.0  0  0)) 

(PLATFORM  (BRICK  20.5  9.125  3.15) 

(REF  TANK  TOP) 

(MTRSP  .375  0  -2.5))  ] 

ATTACHMENTPOINTS 

[  (PUMPPLACE  (REF  PLATFORM  TOP)  (MTRSP  5.85  2.45  0)) 
(MOTORPLACE  (REF  PLATFORM  TOP) 

(MTRSP  -3.15  0  0)  (MROT  "Z"  -90,0)) 
(PLATFORMBACK  (REF  PLATFORM  BACK); 
(PRESSURESWITCHPLACE  (REF  TANK  TOP) 

(MTRSP  -lx. 5  0  0))  ] 

MOTOR  PLACE 


(el  TANK 


SA-3805-12C 


FIGURE  12  GEOMETRIC  MODEL  OF  WORKSTATION  (Continued) 


PUMP: 


MOTOR: 


STRUCTURE  [  (CRANKCASE  (BRICK  5.0  3.5  5.5)) 
(CYLINDER  (BRICK  3.1  3.1  5.0) 
(REF  BOTTOM  CYLINDER))  ] 


STRUCTURE  [  (MOTOR  (H0R17.0NTALCYLINDER  6.75  5.5) 
(MTRSP  0  0  .15))  ] 


(e)  MOTOR 
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FIGURE  12  GEOMETRIC  MODEL  OF  WORKSTATION  (Continued) 


BELTHOUSINGFRAME: 

STRUCTURE  [  (BELTHOUSINGFRAME  (BRICK  21.0  3.0  12.0) 
(MROT  "X"  90.0) 

(MTRSF  1.1  1.5  -.7))  ] 


«l  BELT  HOUSING  FRAME 


PRESSURESWITCH: 

STRUCTURE  [  (SUPPORT  (CYLINDER  3.7  1.0)) 
(COVER  (BRICK  3.6  2.7  3.0) 
(REF  SUPPORT  lOP)) 

(GAUGE  (CYLINDER  1.0  2.2) 
(MTRSP  0  --.5  2.4) 

(MROl  "X”  -90.0))  ] 


SA-3805-12e 


FIGURE  12  GEOMETRIC  MODEL  OF  WORKSTATION  (Continued) 


HORIZONTALCYLINDER: 

PARAMETERS  (LENGTH  DIAM) 

STRUCTURE  [  (CYLINDER  (CYLINDER  LENGTH  DIAM) 

''MTRSP  (MINUS  (FQUOTIENT  LENGTH  2)) 
0 

(FQUOTIENT  DIAM  2.0)) 

(MROT  "Y"  -90.0))  ] 

ATTACHMENTPOINTS 

[  (BASE  NIL) 

(TOP  (MTRSP  0  0  DIAM)) 

(END  (REF  CYLINDER  TOP))  ] 


(h»  HORIZONTAL  CYLINDER 

SA-3805-12f 

FIGURE  12  GEOMETRIC  MODEL  OF  WORKSTATION  (Concluded) 


Since  descriptions  exist  only  as  rroperty  lists 
attached  to  the  atoms  reoresentim  model  oarts,  and  since  any  cart 
may  hA  represented  several  times  in  a  cjiven  scene  or  assembly  with 
different  actual  parameters#  a  function  is  necessary  that  will  create 
actual  Parts  ,2*  copies  of  the  model  Darts.  The  function  CPFATF 
accomplishes  this  in  two  passes  throuqh  the  data  structure. 


CRFATF  must  be  aiven  a  part  name  from  which  to  create 
a  copy#  actual  parameters  (If  appropriate)#  and  a  position  in  which 
to  Place  t)ie  completed  assembly.  In  the  first  mass,  the  hierarchv  of 
the  part  Is  explored,  conies  of  each  part  created,  actual  parameters 


evaluated,  and  relative  Positions  calculated  within  each  level  of 
hierarchy.  In  the  second  nass,  the  relative  positions  are  accuniiiated 
to  aive  an  acutal  oosition  for  each  pepher  of  the  assembly.  The 
primitiye  objects  that  form  the  terminal  nodes  of  the  hierarchy  are 
passed  to  the  SAii.  seament  with  their  actual  dimensions  and  positions 
for  incorporation  into  the  ooiyheirai  data  structure.  The  result  of 
the  call  on  C^LATt  is  a  cony  rf  the  model  oart,  with  all  actual 
parameters,  sizes,  ard  Positions  evaluated, 

V’hat  we  h;ive,  then.  Is  a  method  of  specifvlnd  a 
hierarchical  oroanlzarimn  o(  parts  and  suboarts,  uslno  some  verv 
Simple  primitives  a-  the  terminals.  This  method  Is  more  human 
oriented  than  previously  puniished  methods  In  that  It  allows  the  use 
of  symbolic  attachment  points,  and  It  allows  the  use  of  parameters  to 
specify  dimensions  and  other  variaole  information  that  win  be 
suDplled  at  evaluation  time. 


The  data  structures  and  functions  already  implemented 
could  form  the  basis  tor  an  interactive  oarts  desion  system.  Although 
we  have  not  done  so,  it  would  be  relatively  easv  to  add  facilities  to 
display  a  continuously  undated  picture  of  an  assembly  as  the 
proarammer  or  desloner  specifies  a  new  part,  Tn  fact,  we  intend  to 
implement  a  minimal  such  facility  to  specify  new  Parts  when  a  new 
domain  for  the  CPC  project  is  chosen. 

A  class  of  narts  that  have  not  been  well  modeled  by 
our  method  are  nonriold  parts,  such  as  cables  and  belts.  To  deal 
with  these  in  the  future,  wp  oroPose  to  implement  a  new  class  of 
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primitive  called  "snakes."  These  will  consist  of  a  cross  section 
description  and  a  set  of  constraints  on  a  soace  cirve  aiono  which  the 
cross  section  Is  traced.  Such  an  approach  to  object  descriptions  has 
been  described  by  Aqln  127].  Aithounh  details  have  vet  to  bp  worked 
out»  It  seems  likely  that  specification  of  the  lenotb  of  a  snake  and 
the  posltinns  of  its  end  points  win  be  'isefi-il  for  most  of  the 
purposes  we  epvlslop. 

3.  Geometric  and  Spatial  *-‘odel  s --V  1  s  1  h  le  nutllnes 

This  section  discusses  the  alnorlthms  that  use  the 
symbolic  models  in  order  to  Identify  and  point  to  narts  of  a  real 
compressor  with  the  TV  camera  and  laser  pointer.  RUt  first#  a  brief 
discussion  of  thP  SAlL-ba-ed  data  stricture  js  in  order. 

Information  about  Polybedra  Is  contained  In  short 
contlouous  blocks  of  core  that  we  call  nodes.  ^  node  is  14  words 
lono#  and  contains  a  mix  of  two  types  of  data;  addresses  of  related 
nodes,  and  tloatino  point  numbers  reoresentlno  dimensions, 
coordinates,  or  vectors. 


Cor respond  1  no  to  each  actual  primitive  nart  In  the 
LISP  data  structure  Is  a  polyhedral  reor esentat Ion  called  a  "body 
node."  ICyilnders  are  approximated  by  elobt-slded  orlsms.  Bricks 
and  wedoes  are  themselves  Polybedra.)  The  bodies  are  linked  tooether 
hierarchically  to  form  "oblects,"  dupilcatlnq  some  of  the  structural 
Information  of  the  LISP  parts,  Relow  the  level  of  bodies  are  "faces," 
"edoes,"  and  "vertices,"  on 
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The  structure  of  a  horjv,  an^  its  fares,  edaes,  and 
vertices  follows  thr  winaed-edoe  rerr esent at  1  on  described  bv  Baumnart 
[<?«]»  Which  rray  he  Mir"mdtUed  briefly  as  follows. 

Most  of  the  toooloqlrai  onnnec  1 1 '/ 1 1  v  InforTiatlon 
about  the  body  is  carried  in  edqe  nodes.  tach  edoe  node  contains 
Dolntprs  to  the  faces  on  each  side  of  the  edue,  to  the  vertices  or 
each  end,  and  to  four  nelqhborlno  edoes.  ihe  vert«*x  nodes  contain  the 
actual  x-y-z  coordinates  of  the  vertex,  while  the  face  nodes  contain 
a  4 -element  Vect  or  al  vino  the  oiane  e'JUat  ton  of  the  face  in 
homoaeneor.s  coordinates.  Tn  addition,  tnere  is  soace  In  each  fare  and 
vertex  node  for  t r ans f orired  coordinates  olvlnq  the  sane  Infornatlon 
In  the  coordinate  frane  of  the  TV  camera  nr  laser  oolnter,  fFr'^quer^t 
mention  win  he  nade  jn  this  section  of  homooeneous  coordinates,  and 
of  t rans  lat 1 ons ,  rotations,  and  oroiectivo  transformations  based  on 
homooeneous  coordlnares.  It  is  heyond  tne  scooe  ot  this  reoort  to 
describe  them.  The  Interested  reader  Is  advised  to  refer  to  niif^a  and 
Hart  r?q]. 

Associated  with  each  object  Is  an  "encloslna  sphere". 
Contained  In  the  object  node  are  the  radius  and  the  location  of  the 
center  of  a  sphere  within  which  the  object  win  be  entirely  enclosed. 
These  spheres  are  extremely  useful  in  some  of  the  aluovlthms  to  he 
described  later  for  mlnlmlzlna  search.  For  an  object  composed  of 
onlv  one  primitive  rolvnedron,  this  sphere  may  oe  calruiated  from  the 
dimensions  and  location  of  the  DolVhedrnn.  In  the  process  of 
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combining  two  or  more  objects  to  form  -=1  more  complex  one,  a  simple 


geometric  calculation  will  find  a  sphere  (but  not  necessarily  a 


minimal  one)  that  encloses  the  union  of  the  enclosing  spheres  of  the 


Individual  oarts 


A  stralahtfor Ward  use  of  the  polvhedral  models  is  In 


the  presentation  of  a  visual  display  of  t-he  compressor.  A  set  of 


subroutines  can  convert  the  polyhedral  reor esentat Ion  of  bodies  to  a 


set  of  vectors  In  homogeneous  coordinates.  The  term  "wire  model 


appropriate  here  because,  as  shown  in  Figure  H 


hidden  lines  and 


FIGURE  13  WIRE  MODEL  OF  THE  COMPRESSOR 


baclr  faces  are  net  removed,  and  the  dtsolay  looks  like  a  coiipctlon 
Of  "Wires"  aiono  the  edoes  of  the  mode],  ThP  user  has  control  (from 
the  keyboard)  of  the  virtual  camera  throinh  which  the  scene  is 
viewed.  Thus  the  dtsolay  mav  be  rotated,  translated,  shrunk,  or 
enlarqed,  A  soecial  srllt-screen  vIpwpt  allows  vipwinj  the  imaae  in 
binocular  stereo. 


The  commands  to  alter  the  dtsolay  are  not  now  in  a 
form  such  that  an  aporentice  co'Md  pasiiv  control  it.  But  it  should 
not  be  difficult  In  the  future  to  deslqn  control  lannuaoe  to  use 
such  commands  as  "move  left,"  "zoom  in,"  "tilt  un,"  or  "rotate." 

The  aloorlthms  for  oolntlnq  at  and  Identlfyinq  parts 
of  the  compressor  depend  upon  precise  knowiedqe  of  their  Positions 
and  orientations.  This  is  because  the  locations  of  the  ooiyhedra] 
models  are  assumed  to  be  correct,  and  reference  is  not  made  to  the 
Imaqp  of  the  compressor  as  such.  We  presume  we  can  calculate  from  the 
LISP  model  pkactlv  where  the  imaae  of  each  oart  would  appear  on  a  TV 
Dlcture,  and  make  no  checks  to  ascertain  that  this  is  actually  the 
case.  (We  are  currently  enoaoed  In  efforts  to  identify  the  compressor 
in  imaqes  obtained  from  the  TV  camera  or  from  the  laser  used  as  a 
ranqe  finder.  This  information  will  he  used  to  calculate  the  actual 
Position  of  the  compressor,  and  update  nur  snatia]  models.) 

"Calibration"  Is  the  procedure  bv  which  we  calculate 
the  transforms  and  internal  paramet'^rs  for  the  laser  pointer  and  TV 
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c^Tiera.  Th^'se  transfor-ns  r^re  necessary  If  we  are  to  be  aoie  to 
calculate  imaae  coor'ilnates  trrir  positions  In  snace  anrt  vice  versa.  A 
Set!  1  au t oma 1 1  c  nrorp'iure  tor  calibration  entails  aimlm  the  laser  at 
various  places  about  the  room  wherp  pieces  of  oraph  oarer  have  been 
precisely  located  on  thp  'A'an  or  table  ton»  and  tvplnn  into  the 
computer  the  nraon  rootdlnatps  at  wnicb  the  beam  hits  the  oaoer. 
Based  on  these  locations  and  the  deflections  applied  to  the  laser,  it 
is  possible  to  calculate*  (by  an  Iterative  "hill  climbino"  aloorltbm) 
a  transform  that  oives  the  best  correspondence  between  predicted  and 
actual  oraph  coordinates.  The  tv  camera  may  be  similarly  calibrated 
by  usinq  the  raster  coordinates  of  the  brlqht  soot  In  the  imaqe  where 
the  laser  strlices  the  oraoh  caoer. 

To  checV'  the  corr esoondence  of  the  model,  the  actual 
Compressor,  and  tbp  TV  calibration,  it  is  sometimes  useful  to 
sunerlmoose  on  the  same  display  a  dlaltized  Tv  Imaoe  and  the  "wire 
model"  of  the  compressor.  Fiaure  14  shows  such  a  dlspiav, 

Dnce  Correspondence  is  established,  we  can  find  the 
Intersection  of  a  ray  In  space  with  the  compressor.  This  is  how  we 
identify  parts  pointed  to  by  the  apprentice.  He  points  with  a  wand 
with  a  small  linht  bulb  at  its  tlo.  The  liabt  bulb  is  Identified  as 
the  briohtest  spot  in  a  TV  picture  of  the  scene.  (The  laser  nolnter 
mioht  also  create  a  brlabt  snot  in  the  Picture,  dependinq  on  where  it 
is  aimed.  Put  a  areen  filter  In  front  of  the  camera  eliminates  this 


FIGURE  14  WIRE  MODEL  SUPERIMPOSED  ON  TV  IMAGE 


possible  airblaultv.)  The  stralaht  line  connectlna  the  camera  center 
and  the  llqht  bulb  defines  the  ray  in  space,  whose  intersection  with 
the  compressor  model  we  are  to  find. 


The  llnht  b'Jlb  must  be  touchlno  or  in  close  proximity 
to  the  part  the  apprentice  wishes  Identified.  (To  maXe  it  possible 
for  him  to  point  to  the  Dart  from  a  distance  would  require 
determinino  the  position  of  the  wand  in  three  dimensions.  Locatino 
lust  the  tip  Of  the  wand  entails  only  a  two-dimensional  determination 
of  its  imaqe  coordinates.) 


p'nr  Intersect! m  the  rav  vlth  the  mniielf  It  is  uspful 


tn  wori*’  in  the  prdectlvp  cnnrrilnate  svste'T'  of  thv?  TV  carr'era.  The 
rav»  In  this  coor'llnate  snace.  is  a  llna  nt  constant  r  anri  .T  crhe 
image  coordinates  nieasured  for  the  nriaht  snot.)  {Starting  with  tne 
object  node  representlna  tne  entire  ■vor'>'shop  doi^ain,  nojects  whose 
tr ans tortned  enclosina  spheres  do  not  Include  the  coordinates  of  the 
ray  are  eliminated,  and  those  that  do  are  broken  down  into 
subobjects,  until  we  arrive  at  a  set  of  candidate  bodies  that  cannot 
be  ruled  out  on  the  basis  of  their  enclosina  spheres.  Further 
analysis  of  the  oolyhderal  reoresentation  of  each  body  yields  either 
(11  the  distance  from  the  camera  at  wnich  the  rav  strikes  a  fare  of 
the  Dolvhedron  or  (7)  tne  fact  that  tne  raV  does  not  strike  the  body 
dt  all.  Based  on  these  distances,  the  body  closest  to  the  camera  is 
identified  as  the  one  Pointed  to, 

^n  alternate  procedure  is  sometimes  used.  This 
entails  subdlvidlncj  the  scene  (as  seen  by  the  iv  camera)  into  a 
coarse  "vislbllltv  matrix"  of  40  x  40  points.  Agin  and  'Mltzan  flO] 
describe  a  procedure  by  which  a  matrix  reoresentation  of  the  edges  of 
a  polyhedron  may  be  derived,  and  the  interior  of  the  resultino 
outline  marked  or  "colored  in"  .  An  of  the  objects  in  the  scene  are 
sorted  by  their  distance  from  the  camera.  Then  starting  with  the 
farthest  object,  the  polvhedra  that  make  un  th»  object  are  "colored" 
With  a  number  Identifying  that  object.  Where  the  images  of  two 
objects  overlap,  the  number  of  the  nearer  overwrites  the  number  of 
the  farther.  Figure  is  shows  the  result  of  applying  this  Procedure 
to  the  model  of  the  compressor, 
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FIGURE  15  VISIBILITY  MATRIX 
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with  this  rreco’Tiriuted  matrix,  detarmlnlnq  what  Is 
beina  pointer*  to  by  the  liqht  wan'^  requires  only  convertinn  the 
coordinates  of  the  hrlqht  spot  into  the  aroroprlate  Indices  of  the 
matrix,  and  retrlevim  the  Identifyinq  ntimKer  stored  there. 


This  visibility  matrix  orocedure  provides  a  taster 
response  to  earn  Identification  request,  at  the  cost  of  increased 
computation  riurlnq  the  mode  1 -bu 1 1 dino  Phase,  In  addition,  the  matrix 


must  be  recoirputei  each  time  the  relative  positions  of  the  camera  and 
comortssor  chanoe.  The  sortina  of  onlerts  by  distance  of  sphere 
Centers  '  rom  the  camera  Is  not  always  quaranteed  to  v^orir,  hut  for  the 
cases  we  have  tried,  the  results  have  been  adequate.  Thus,  althouah 
the  visibility  matrix  approach  Is  the  one  we  aenerally  use,  we  are 
aware  of  its  limitations,  and  have  the  more  reliable  rav  intersection 
method  to  fall  oacV'  on  Should  cases  arise  where  the  faster  method 
fails. 


Peoardless  of  wqich  procedure  is  used,  the  SAIL  fork 
passes  to  tne  MSP  fork  the  address  of  the  obltct  node  it  found,  hy 
referrinq  to  a  table  of  node-Part  correspondences,  a  particular 
primitive  part  is  retrieved.  There  remains  the  problem  of  translation 
tnis  primitive  Into  a  meanlnqfui  response  to  the  orloinal  question, 
"What  Is  this?"  A  possible  solution  would  be  toreturn  the  entire 


ancestry  of  the  Part  in  its  hierarchy,  such  as  fHOnp  COMPRESSOR 
COMPPESSOR-ON-BASE  COMPRESSOR  PUMp  pUMp  P I STOM -C YL I NDER  ERICK  1,  But 
such  an  answer  is  unnecessarily  lorn  and  redundant.  For  lack  of  a 


^  **«*  * 


*•  ••  /•  *-  . 
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better  mode]  of  what  Is  wanted,  our  solution  is  to  r»‘olv  with  tho 
smallest  nonprlmltlve  Par.  to  which  the  primitive  belonos,  and  the 
symbolic  substructure  name  of  the  primitive.  ihe  above  exampir 
reduces  to  fPliMP  PT  STPN-c  YT.  r^pFU ) .  a  tew  snerlal-rase  rules  take  care 
of  Instances  where  such  an  answer  wou]d  be  InaoproPr 1  ate  or 
ridiculous.  Clearlv,  here  Is  a  case  where  models  of  the  dlaloo  ^nd  a 

model  o_  the  apprentice  would  help  in  formulating  an  appropriate 
response , 


The  converse  of  Part  Identification  Is  nolntlno.  An 
Apprentice  may  ask  "where  Is  the  nlatform?"  and  expect  the  computer 
to  point  to  the  Platform  (on  top  of  tpe  tank)  with  the  laser  Pointer. 
Satlsfvlnq  this  request  entails  two  sterst  fihdino  an  outline  of  the 
Platform  (taklno  into  account  anv  parts  that  mav  be  in  front  of  the 
Platform  and  hide  a  portion  of  in,  and  Iccatlnq  a  point  near  the 
centroid  of  the  outline  at  wMcn  to  Point. 

The  first  Part  maV  be  accomn 1 1 shed  bV  USlna  a 
visibility  matrix  such  as  the  one  orevlously  shown  in  Floure  IS. 
(in  this  case,  (.he  matrix  must  be  computed  in  laser  coordinates 
ra.her  .  an  TV  coordinates,  so  a  separate  matrix  is  necessary.)  nr 
the  outline  of  the  desired  cart  may  he  obtained  hv  the  method  of  Ref. 
31.  Those  Oblects  whose  enclosing  spheres  Indicate  the  possibility 
Of  nldinn  a  portion  of  the  Platform  wm  pp  simiiarlv  outlined  and 
their  "colored  in"  portions  subtracted  from  the  original.  The 
orooedures  for  recognizing  occlusion  and 


for  subtracting  the  nariced 


areas  are  riescribeii  In  detail  by  f'Jltzan  ('<1),  'live',  tb^  'matrix 
reorespnt at i on  of  tbe  vjsjhle  rortton  of  the  desired  oblect,  its 
centroid  may  be  found  bv  tbe  netbod  of  "chan f er 1  no , "  described  In 
Ref.  1?.  The  x  and  y  Indices  of  the  c''ntrold  nolnt  are  converted  to 
the  appropriate  laser  deflection  constants,  and  the  laser  pointer 
will  then  rrove  so  as  to  mint  near  the  center  o'  th<»  nart. 

D,  Deductive  Retrieval  Mechanisms  tor  State  Description  Models 

1.  Introduction 

This  section  describes  some  modellnd  facilities  that 
have  been  developed  as  part  of  the  CBC,  The  models  that  we  are 
concerned  about  here  could  be  descriptions  of  any  enylronment  of 
interest  at  specific  instances  in  time.  Each  such  description  is 
Said  to  model  a  "state"  of  the  environment,  and  a  state  can  be 
transformed  into  a  new  state  by  an  eyent  that  alters  the  enylronment. 
For  the  CBCf  these  models  describe  the  state  of  the  wor ks tat ion-- 
including  the  device#  tools,  test  equipment,  and  so  on--dnd  the 
events  are  primarily  maintenance  and  repair  ooerations  performed  py 
the  apprentice. 

Proarammlnq  foe  tittles  for  querying  state  description 
models  and  for  updating  them  to  reflect  the  occurrence  of  an  event 
are  vital  in  many  Al  systems,  particularly  those  that  do  question 


answerina  and  those  that  do  automatic  aeneratloi*  and  execution 
monitoring  of  plans.  Planners,  for  example,  use  these  models  to 
simulate  potential  operator  fevent)  sequences  and  to  investigate 
their  consequences, 

Tne  modeling  mechanisms  to  oe  described  here  are 
basically  extensions  and  modifications  of  facilities  tynlcally  found 
in  recent  planninn  program',  implemented  in  lamuaqes  such  as  CO''(NlVcP 
133],  PLANNPP  134],  and  QA4  [35],  Tr.e  need  for  such  additional 
knowledge  representation  mechanisms  is  evident  as  Al  projects 
continue  to  move  in  the  direction  of  conslderlnq  mo,e  complex  task 
domains.  The  presentations  here  are  meant  to  add  an  increment  to 
our  ability  to  deslon  and  build  such  large  systems, 

^  *  Expressions,  states,  and  Contexts, 

Our  modeling  system  is  Implemented  as  an  extension  of 
the  ULISP  programming  language  C18J,  E;ach  state  description  model  can 
be  thought  of  as  a  set  of  QLISP  expressions,  with  each  expression 
ha.'*  ig  a  truth  value  associated  with  it.  An  expression  typically  Is 
a  statement  of  a  relationship  among  entitles  in  the  task  domain  such 
as  objects,  concepts,  or  other  relationships.  For  example,  the 
expression  (CONNFCTFn  pump  platform)  is  a  statement  that  the  pump  is 
connected  to  the  Platform,  and  the  expression  (FASTENFP  (CONNECTION 
PUMP  PLATFORM)  bOLTil)  is  a  statement  that  BOLTM  is  a  fastener  of 
the  pump*piat f orm  connection. 
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We  use  the  QLISP  context  mechanlsip,  which  allows  the 
iYstem  to  build  and  manloulate  a  tree  of  state  descriptions  without 
havlnq  to  create  and  maintain  a  complete  cooy  of  each  state,  tach 
node  in  this  "context  tree"  denotes  a  state.  To  represent  the  new 
state  that  is  produced  by  the  occurrence  of  an  event  in  some  state 
Si,  the  system  creates  a  new  node  In  the  context  tree  as  a  direct 
descend ent  of  the  Si  node.  All  information  in  state  Si  that  is  rot 
explicitly  chanqed  in  the  new  state  Is  assumed  to  also  hold  in  the 
new  state.  That  ls»  each  state  inherits  model  information  from  the 
state  that  is  its  parent  in  the  context  tree. 

The  QLISP  Context  mechanism  depends  on  the  fact  that 
all  information  associated  with  an  expression  in  the  data  base  is 
stored  on  the  expression's  property  list.  The  presence  of  an 
expression  in  the  data  base  implies  only  that  there  has  been  a 
reference  to  the  expression  (as  with  LISP  atoms),  but  says  nothlnq 
about  any  of  its  properties,  includinq  its  truth  value,  A  QLISP 
expression  actually  nas  a  collection  of  property  lists,  one  for  each 
state  in  which  some  information  has  been  stored  about  the  expression. 
Hence,  when  an  expression  is  asserted  as  being  true  in  some  state  SI, 
TRUE  is  stored  as  the  value  of  the  property  TRUTHVALUE  on  the 
expression's  Si  property  list. 
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3.  Oueryincj  State  Description  Models 

a.  Trutn  Values 

A  state  description  model  Is  a  source  of 
information  about  a  particular  situation,  and  Its  primary  use  is  as  a 
data  base  for  answering  queries  about  -ne  situation.  nur  modellna 
system  Interacts  with  its  users  (both  people  and  programs)  as  if 
QLISP  expressions  iultb  truth  values  attached  were  the  only 
representations  being  used.  Hence,  all  queries  from  outside  the 
modeling  system  concern  the  truth  value  of  expressions  in  some  given 
state . 

when  answering  a  query  about  a  particular 
expression  in  some  given  state,  the  system  searches  for  a  truth 
Value.  The  search  begins  with  the  property  list  for  the  given  state. 
If  the  property  THiiTHVALUf:;  has  no  value  on  that  property  list,  the 
property  list  tor  the  given  state's  parent  (in  the  context  tree)  is 
checked.  The  search  continues  in  this  manner  until  a  value  is  found 
or  until  all  the  states  in  the  context  are  considered.  If  no  value  is 
found,  the  search  returns  Unkmown  as  its  result.  Since  any  expression 
can  be  stored  as  the  value  of  property  I'HLJTHVALUK,  this  retrieval 
mechanism  allows  use  of  an  N-valued  logic.  Kor  example,  one  could 
naVe  "fuzzy"  truth  values  represented  as  integers  from  -lOO  to  +100. 
For  our  models,  we  currently  are  using  a  i-valued  logic  that  allows 
the  system  to  distinguish  expressions  that  are  "known  true",  "known 


false"*  or  "have  unknown  trurh  value"  in  any  qiven  state.  This  is  the 
slmpllst  logic  that  meets  c  modeling  system's  needs  since  state 
descrlution  models  are  inherently  incomplete*  and  It  Is  Important  for 
the  system  to  be  aware  of  what  it  does  not  know  as  well  as  what  it 
does  know, 

b.  Generators  Instead  of  Backtracking 

OLISP  provides  facilities  for  assoclatl vely 
retrieving  expressions  from  the  data  base  that  match  any  given 
pattern*  where  a  pattern  is  defined  to  be  an  expression  that  contains 
unbound  variables.  The  OLISP  statements  for  querying  the  data  base 
use  this  pattern  matching  facility  and  are  similar  to  the  query 
statements  found  in  PLANNER  and  0A4,  They  are  designed  to  find  a 
Single  instance  of  a  given  pattern.  To  cause  the  pattern  matcher  to 
continue  its  search  and  obtain  another  such  instance*  the  user's 
program  must  return  to  the  query  statement  via  the  language's 
backtracking  mechanism  (i.e.,  by  "failing"). 

Using  backtracking  in  this  way  to  sequence 
through  a  class  of  expresslv.ns  that  all  match  a  given  pattern  has 
severe  limitations  in  that  it  ties  the  sequential  production  of  each 
expression  to  the  control  structure  of  the  user's  orooram.  In 
Particular*  it  requires  that  the  same  portion  of  the  user's  program 
be  executed  for  each  expression  (namely,  the  statements  immediately 
following  the  query  statement).  Also*  since  all  the  backtrackable 


effects  of  that  Portion  are  belnq  "unrJone"  after  each  failure^  it 
makes  cumbersome  the  savlnq  of  results  tor  ^ach  expression  oenerated. 
Such  a  backtracklr.q  mechanism  is  best  suited  to  a  "oenerate-and-test " 
Situation  vvnere  the  user  desires  a  sinqle  expression  tnat  not  only 
passes  the  query  statement's  tests,  but  also  passes  additional  tests 
included  in  the  user's  proqram. 

We  have  adopted  the  rriNNivLR  solution  to 
these  limitations  in  our  modelinq  system  bv  orovidina  functions  that 
are  generators  of  expressions  from  the  data  base.  For  example,  there 
is  a  generator  version  cf  the  QLISP  is  statement  called  Gl.Nris  that 
finds  instances  of  a  given  pattern  having  truth  value  TRUF  m  a  given 
state.  Each  time  a  generator  function  suen  as  GENris  is  called,  it 
produces  as  many  expressions  as  is  c-nvenlent  tor  it.  These 
expressions  are  put  on  a  "Possibilities  list"  along  with  a  "tag"  that 
indicates  how  the  generator  can  be  restarted  when  more  expressions 
are  requested,  and  this  possibilities  list  1:  returned  by  the 
generator  as  its  value, 

if  the  function  TRVz.iEXT  is  called  vith  a 
possibilities  list  as  an  argument,  it  wm  remove  the  first 
expression  from  the  list  and  return  it  as  a  value.  jf  the 
possibilities  list  cc.Ttalns  no  expressions,  then  TpyrNEXT  attemots  to 
produce  new  ones  by  using  the  tag  to  restart  the  generator.  Since 
each  call  to  TFY.'NEXT  can  be  made  from  anywhere  in  the  user's 
program,  generators  of  this  form  successfully  separate  the  production 
Of  a  next  data  element  from  the  processing  that  is  done  on  each 


element . 


"onslder » 


for  example/  a  set  of  queries 


concerninq  which  components  are  connected  to  the  pump  In  state  Si, 
They  can  be  Initialized  as  follows: 

(SETO  PI.  (GEN:IS  (CnNNECTEl)  PUMP-C)  SI)). 

Then  whenever  one  of  these  components  Is  needed/  evaluation  of 
(TRY:NEXT  PL)  wm  return  a  true  Instance  of  the  pattern  (CONnECTF'.D 
PUMP  *-C)  and  will  set  the  value  of  the  QLISP  variable  C  to  be  the 
"found"  component. 


We  have  Implemented  proqramminq  facilities  to 
support  the  writing  and  use  of  generator  functions  using  INTEHLISP 
FUNARGS,  A  FUNARG  is  a  data  Object  that  conceptually  represents  a 
copy  of  a  function  and  a  private  data  environment  for  that  copy.  This 
FUNARG  implementation  allows  the  definition  of  a  generator  function 
to  Include  a  set  of  variables  (l,e,/  a  data  environment)  whose  values 
will  be  Saved  and  restored  each  time  the  generator  is  restarted. 
These  "own  variables"  allow  the  generator  function  to  save  pointers 
indicating  where  It  Is  In  Its  search  for  generatable  Items.  The 
FUNARG  Is  added  to  the  possibilities  list  as  the  "tag"  that  THY;NEXT 
uses  to  restart  the  generator.  Included  In  the  implementation  are 
CONNiVER-style  functions  such  as  NOTE/  AU-REVOIP/  ADIEU/  and 
TRY'NEXT/  which  make  the  definition  and  use  of  generators  convenient 


and  practical. 


The  Query  Functions 


c . 


can  now  describe  our  model  oiipryjno 
mechanism.  The  foliowim  query  functions  are  available: 

(DEDUCE;L)NE  <pattern>  <context>), 

(JEDUCE:EACH  <pat1'. ern>  <ccntext>)» 

(DEIHICE:ALL  <pattern>  <context>), 

f«FFlrrE:GME  <pattern>  <context>), 

(  MEFliTE :  EACH  <pattern>  <context>), 

(PEFUTE;Ai,L  <pattern>  <context>). 

The  deduce  functions  find  Instances  of  the 
pattern  that  are  true  In  the  given  context,  and  the  PEFUTt  functions 
find  instances  of  the  pattern  tnat  are  false  in  the  given  context. 
The  toNE  functions  find  only  a  single  instance  and  are  not 
restar  table  j  the  :EACH  function’;  are  generators  and  return 
possibilities  lists;  and  the  ;all  functions  return  a  list  of  all  the 
flndable  Instances. 


Known  truth  values  are  usually  not  all 
explicitly  stored  In  a  model.  Instead,  the  user  provides  derivation 
functions  that  compute  them  when  they  are  needed.  These  functions 
may  embody  for.,al  theorem  proving  strategies  or  slmriy  be  statements 
of  impllcational  rules  derived  from  the  semantics  of  the  task  domain. 


They  serve  to  extend  each  model  in  the  sense  that,  from  the  cal  linn 

program's  point  of  view,  the  derived  Instances  of  a  pattern  are 
indistinguishable  fron  instances  actually  found  in  the  model. 

Our  query  functions  are  similar  to  a  njArj\)KR 
or  OA4  GOAL  statement  in  that  they  first  use  the  pattern  matcher  to 
find  suitable  Instances  of  the  pattern  in.  the  data  base  and  then,  it 
more  instances  are  needed,  they  call  user  supplied  functions  to 
attempt  derivations  of  the  desired  Instances,  These  functions  are 
assumed  to  be  generators  that  produce  derived  instances  of  the 
pattern , 

A  typical  deduction  function  in  the  CbC 
system  finds  and  generates  true  Instances  of  patterns  of  the  form 
(POSITIONED  X  «- Y)  by  using  DEDUCtiLACH  to  find  true  instances  of  the 
Pattern  (ATTACHED  $X  $Y),  since  components  that  are  ATTACHED  are 
assumed  to  be  POSITIONED,  A  typical  refutation  function  finds  and 
generates  false  instances  of  patterns  ot  the  form  ( POSITIONED  X  »-Y) 
by  using  DEDUCEtEACH  to  find  true  instances  of  the  pattern  (HEMilVED 
S\  SY),  since  components  that  are  REMOVED  are  assumed  to  be  not 
POSITIONED. 

These  derivation  functions  are  the  user's 
primary  means  of  expressing  the  semantic  links  among  the  relations 
occurring  in  the  state  description  models.  Also,  they  can  provide  an 
interface  to  .information  that  is  stored  in  representations  other  than 


LISP  expressions.  That  is,  it  fray  ne  much  more  convenient  anu 
efficient  to  store  some  Information  In  arrays,  trees,  or  on  oisk 

files?  deduce  and  refute  actions  serve  as  the  access  functions  to 
these  alternate  data  bases. 


Storaqe  and  Retrieval  of  Action  Functions 


The  first  element  of  each  nonatomlc 
expression  in  the  model  Is  assumed  to  be  the  name  of  a  relation  (or  a 
QLISP  variable  that  Is  to  be  bound  to  a  relation),  Tnerefore,  the 
deduce:  and  refute  functions  can  use  relation  names  as  an  Index  to 
determine  which  derivation  functions  should  be  called,  Accordmolv, 
we  associate  with  ench  relation  name  two  lists  of  derivation 
functions  that  can  derive  instances  of  oatterns  that  beqln  with  the 
relation.  one  list  contains  the  "deduce  actions"  used  hy  the  three 
forms  of  DEDUCE  and  the  other  contains  the  "refute  actions"  used  oy 
the  three  forms  of  REFUTF, 


Savlnn  Derived  Results 


When  a  model  uuery  causes  derivations  to  be 
attempted,  we  want  the  results  of  those  derivations  to  be  stored  and 
retained  in  succeeding  states  as  long  as  they  remain  vallo.  In  this 
way  the  system  achieves  the  maximum  benefit  from  derivations  and 
minimizes  unnecessary  redi»rl  vat  tons . 


PIJ (lu  II  It  y 


A  moriel  query  is  an  attempt  to  tlnd  true  (or  false) 
instances  of  a  qiven  Pattern,  Kach  time  such  an  Instance  is 
determined#  r)ur  DRDUCE'.  and  REFUTE  query  functions  save  the  derived 
result  py  assigt.inq  a  truth  value  to  the  instance  (i.e.,  put  it  as 
the  value  of  THUTHvAlUE'  on  the  exoresjlon's  oroperty  list)  so  that 
the  value  wm  not  have  to  be  rederived  if  it  is  needed  again,  .-or 
example#  if  a  deduce  action  for  ASSEMBLED  determines  :hat  the  pump  is 
assembled  by  querylnq  the  model  about  each  of  the  pump's  components, 
then  the  expression  (ASSEMBLED  PUMP)  will  be  assigned  a  TPUTUVALUE  of 
true . 


If  a  query  is  one  of  the  :ALL  forms#  or  if  It  is  an 
lEACh  form  and  the  aeneratlon  continues  until  all  derivable  Instances 
of  the  pattern  are  produced#  or  if  the  query  pattern  contains  no 
unbound  variables  (and  therefore  has  only  one  Possible  instance)# 
then  the  system  also  records  the  fact  that  all  Instances  of  the 
pattern  have  been  derived,  if  the  same  query  is  repeated#  the  system 
will  )cnow  that  the  cCtlon  functions  cannot  find  any  new  instances  and 
can  therefore  prevent  ill-fated  attempts  at  rederivation.  For 
example#  if  during  a  query  all  the  components  that  are  positioned 
with  respect  to  the  pump  have  been  found  as  instances  of  the  pattern 
(POSITIONED  PUMP  -C)#  then#  when  that  information  is  requested  in  a 
later  query#  derivation  functions  such  as  the  one  that  looks  for 
components  attached  to  the  pump  will  not  be  recalled. 

These  "set  completeness  Indicators"  are  also 
frequently  useful  to  Indicate  the  case  where  there  are  no  derivable 


Instances  of  a  pattern.  For  example.  If  all  derivation  attempts  are 
unsuccessful  at  detemlnlno  wnether  the  pump  is  assembled,  then  the 
set  of  derived  instances  is  empty  and  mrsrxed  as  complete. 

Clur  alqorlthms  for  maintaining  these  derived  results 
in  succeeding  states  depend  on  availability  of  the  "suoport"  for  each 
derivation.  The  ''support''  tor  a  derived  Instance  Is  defined  to  be 
those  expressions  from  the  model  that  are  used  as  axioms  in 
constructing  the  derivation.  For  example,  if  an  action  function 
queries  the  model  for  the  locations  of  twn  objects  and  concludes  that 
one  of  the  objects  is  above  the  other,  then  the  locations  of  the  two 
objects  form  the  support  set  for  the  result.  Actually,  since  any 
model  query  may  return  a  derived  result,  the  support  set  tor  the 
"above"  result  would  he  the  union  of  the  support  sets  for  tne  two 
location  expres  ions. 

A  derived  result  remains  valid  in  succeedlna  states 
as  long  as  Its  support  remains  valid,  we  therefore  nave  the  system 
do  the  required  maintenance  on  derived  Instances  in  new  states  by 
Including  the  following  facility; 

Whenever  an  expression  with  a  known  truth  value  has 
its  truth  value  changed  during  a  model  update,  the 
truth  value  of  each  of  the  expression  that  it  supports 
is  set  to  UNKNOWN  in  the  new  state. 


The  truth  values  of  tnese  "supportees"  may  not  In 
fact  have  chanced  in  the  new  state#  but  the  derivations  that  made  the 
truth  vjiues  known  are  no  lonoer  valid.  If  a  model  uuery  needs  to 
know  one  of  the  deleted  truth  values  In  the  new  state#  a  new 
derivation  must  he  attempted.  For  example#  if  (ATTACHED  I'lJdP 
PLATFORM)  is  the  support  for  (POSITIONED  PUMp  PLATFORM)  and  a  detach 
pump  from  platform  action  causes  a  new  state  to  he  created#  then  the 
truth  Value  of  (POSITIONED  pump  platform)  will  be  set  to  "unknown"; 
the  pump  may  still  be  in  position  on  the  platform,  but  the 
justification  for  the  earlier  conclusion  about  the  pump's  position  is 
no  longer  valid. 

A  similar  mechanism  is  used  to  saVe  and  maintain  the 
"completeness  ndicators"  that  are  attached  to  derived  sets  of 
instances , 

5,  state  Transitions 

a.  Updating  Functions 

The  models  of  state  changing  operators  that  a 
system  works  with  must  contain  sufficient  information  about  the 
effects  of  each  operator  so  that  they  can  be  simulated  and  a 
descripfion  produced  of  the  expected  resulting  state.  As  in  most 
Planning  systems#  we  are  assuming  that  the  application  of  an  operator 
in  some  state  SO  is  modeled  by  producing  a  new  state  Si  that  is 
conceptually  an  updated  copy  of  SO  (i.e,#  SI  is  a  direct  descendant 


of  so  In  the  QLISP  context  tree).  The  effects  of  the  operatoi  are 
indicated  by  assertinq»  denying#  and  deleting  expressions  In  tue  new 
state  SI, 

In  our  frodelinq  systetT,  we  provide  the 

following  set  of  model  updating  statements: 

(SIM:ASSEFT  <expression>  <context>)/ 

(SlM:i)ENf  <expression>  <context>)# 

( S TM : DELETE  <pattern>  <cuntext>). 


SIM:ASSEPT  (SlM:DENy)  Changes  the  truth  value  of  the  given  expression 
to  TRUE  CFAlSE)  in  the  state  indicated  by  the  given  context. 
SIMrDELETE  changes  the  truth  value  of  all  expressions  that  match  the 
given  pattern  to  Unknown  in  the  state  Indicated  by  the  alven  context. 
These  statements  also  call  a  set  of  user  supplied  functions  (like 
PLANNER  antecedent  theorems)  that  typically  make  additional  cnanoes 
in  the  new  model  that  are  direct  results  of  the  assertion#  denial#  or 
deletion  being  done.  These  user  supplied  functions  play  an  important 
role  in  simplifying  operator  models  in  that  they  allow  the  user  to 
express  in  one  place  side  effects  of  particular  assertions#  denials# 
or  deletions  that  always  occur  no  matter  what  operator  does  them.  In 
this  Way#  these  side  effects  do  not  nave  to  be  repeated  in  each 
operator  that  causes  them  to  occur. 


As  in  the  case  of  the  DEDUCF:  and  rEEIITF 


functions  (and  for  similar  reasons)#  we  have  elPCte(i  to  store  the 
user  supplied  updating  functions  on  each  relation's  property  list. 
Hence,  a  relation  can  have  a  list  of  ASSERT : ACTl GNS ,  DKNV ; AC  1 IHMS, 
and  DElETEjACTIons,  These  lists  Indicate  how  a  model  upijatlnn 
operation  should  proceed  for  an  expression  having  the  given  relation 
as  Its  first  element. 

The  updating  functions  also  perform  the 
maintenance  operations  on  derived  results.  This  means  that  if  the 
expression  had  a  known  truth  value  and  that  value  Is  being  changed, 
then  all  the  expression's  supportees  must  he  deleted.  Also,  checks 
are  made  to  determine  if  any  set  completeness  Indicators  should  t)e 
removed. 

b.  Model  Updating  Using  Deduce  and  Refute 

Actions 

Consider  now  a  consistency  checking  Procedure 
that  could  be  applied  as  a  standard  part  of  model  updating.  The 
purpose  of  the  procedure  would  be  to  perform  additional  assertions, 
denials,  and  deletions  that  are  Implied  by  the  given  expression's 
truth  value  change  without  requiring  the  user  to  write  additional 
action  functions.  For  example.  If  the  user  has  written  a  deduce 
action  that  embodies  the  rule  "X  Implies  Y",  then  we  do  m  t  want  him 
to  also  have  to  write  a  deny  action  for  Y  that  removes  from  the  model 
any  truth  values  that  could  be  used  to  derive  X,  The  Information 


necessary  to  do  these  changes  at  the  appropriate  tiire  Is  Incluied  in 
the  orlqlnal  deduce  action. 

This  procedure  would  work  as  follows.  TtiP 
truth  value  ot  the  expression  belnq  updated  would  be  set  to  lii'iKMOvb 
and  an  attempt  would  oe  made  to  deduce  the  expression.  if  this 
attempt  produces  a  successful  derivation,  then  the  new  state  contains 
support  for  the  truth  ot  the  expression  even  thcuoh  It  Is  beinn 
denied.  The  Inconsistency  can  be  eliminated  by  removlno  the  support 
for  the  derivation.  If  the  support  set  has  exactly  one  expression  In 
It,  then  that  expression  can  have  Its  truth  value  reversed.  (Tnls  Is 
the  "X  Implies  Y"  case  where  the  denial  of  y  is  Impiyinn  the  ienlai 
of  X.)  The  reversed  truth  value  would  be  stored  as  a  derived  result 
with  the  original  expression  belno  uPaated  CY)  as  its  support.  I'^fien 
the  support  set  contains  more  than  one  expression,  we  know  that  at 
least  one  of  the  expressions  must  have  Its  truth  value  changed,  lut 
we  do  not  know  which  one(s).  Therefore,  the  best  we  can  do  Is  to 
delete  (l.e.,  make  truth  value  unknown  for)  all  of  the  support 
expressions , 

If  the  system  knows  which  relations  are 
changeable  by  events  and  which  ones  are  true  In  all  states,  then  It 
can  decrease  unnecessary  deletions  ny  removlno  the  unchanaeab le 
expressions  from  the  support  set  before  considering  deletions  or  a 
truth  value  reversal.  After  the  support  for  the  derivation  has  been 

removed,  a  new  derivation  Is  attempted  and  the  Process  Is  repeated 
until  no  new  derivation  can  he  found. 
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This  updating  procedure  does  not  guarantee 


consistency  in  the  new  state  nor  does  It  prevent  later  chanaes  to  the 
state  from  Introducing  new  inconsistencies.  However#  it  does 
automatically  take  care  ot  many  model  uodatinci  details  and  it  removes 
all  ♦‘Xistina  inconsistencies  in  the  state  that  are  riiscoveraole  by 
the  system‘'s  deductive  machinery.  It  the  system  cannot  derive  the 
facts  from  which  an  inconsistency  follows,  then  the  inconsistency  is 
irrelevant  and  can  safely  be  ignored. 

Obviously,  there  are  situations  in  which  this 
procedure  initiates  computationally  expensive  derivations  and  causes 
many  unnecessa-y  deletions.  Hence,  it  must  be  selectively  applied. 
We  .urrently  have  the  entire  process  under  user  control  by  allowipcj 
individual  specification  of  which  deduce  and  refute  actions  are 
employed  to  determine  truth  value  deletions  and  reversals  during 
model  updating. 


Note  that  using  an  "x  implies  Y"  deouce 

action  as  a  deny  action  for  Y  is  not  the  same  as  writing  a  oeny 

action  for  Y  that  simply  denies  X,  The  difference  is  that  in  the 

latter  case  X  would  be  denied  each  time  Y  is  denied,  and  the  deny 

actions  associated  with  X  would  then  trigger  off  other  assertions, 

denials,  and  deletions.  Such  a  process  could  clutter  up  the  model 

with  many  irrelevant  Implications  of  the  dental  of  Y.  However,  in 
the  former  case  where  the  deduce  action  Is  used  as  the  deny  action 

for  Y,  no  Changes  are  made  In  tne  model  if  X  cannot  be  derived;  and 
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if  X  can  be  derived,  only  the  supporters  of  the  derivation  are 
changed.  This  means  that  only  those  truth  values  that  are  actually 
inconsistant  with  the  denial  of  i  are  changed;  no  irrelevant 
implications  are  stored, 

6.  The  Relations  'AND',  'OR',  and  'NtiT' 

AND,  UH,  and  NOT  are  "built  into"  our  modeling  system 
in  the  Sense  that  deduce#  refute,  assert,  deny,  and  delete  actions 
have  been  written  for  each  of  them,  whenever  possible,  conjunct  ions , 
disjunctions,  and  negations  are  decomposed  into  more  primitive  forms 
by  the  action  functions.  For  example,  the  assert  action  for  ANM)  also 
asserts  each  of  the  conjuncts#  and  the  deduce  action  for  NOT  strips 
off  the  NOT  from  the  guery  pattern  and  attempts  to  refute  the 
remaining  pattern. 

The  refute  actions  tor  ANn  and  OR  translate  the  query 
into  a  call  on  DEDUCKjEACH  by  using  the  rules; 

((NOT  Xl)  AND  ,,,  AND  (NOT  Xp))  implies  (NOT  (XI  OR  ,,,  OR  Xp),  and 
((NOT  XI)  OR  ,,,  OR  (NOT  Xn))  implies  (NOT  (XI  AND  ,,,  AND  Xn)  , 

The  deduce  actions  for  AND  and  OP  have  a  important 

role  to  Play  in  that  they  are  the  overlords  of  the  derivations  of 
each  conjunct  or  disjunct.  They  could  each  be  exoanded  int^  full 

problem  solving  executives  that  would  make  use  of  co-mutlne 
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facilities  to  explore  alternative  oerlvations  in  parallel  and 
semantic  information  to  determine  tne  order  in  lA/hich  conjuncts  or 
diduncts  are  conslderec  .  -^e  have  experimented  with  onlv 
Unsophisticated  versions  of  th^se  actions,  but  tne  important  nnint  to 
note  is  that  the  query  mechanism  dives  those  actions  control  over  the 
derivation  so  that  the  option  is  there  to  exnand  them  when  needed. 

7,  Summary 

We  have  described  a  set  of  orodrammind  facilities  for 
buiidinq»  maintainind,  and  queryind  state  description  mooeis.  These 
facilities  are  useful  in  systems  such  as  planners,  question 
answerers,  and  simulators.  They  allow  the  storage  and  retrieval  of 
statements  with  true,  false,  and  unk-nown  truth  values,  and  provide  a 
proqramming  environment  that  allows  derivation  rules  embodying  the 
semantics  of  a  task  domain  to  be  easily  added  as  functions  to  the 
system.  These  rules  can  also  he  used  to  assist  in  modeling  the 
effects  of  an  operator  that  creates  a  new  state.  Facilities  are 
provided  to  save  the  results  of  these  derivation  functions,  and  to 
delete  the  results  in  new  states  where  the  derivations  are  no  longer 
valid,  F'inally,  the  semantics  of  conjunctions,  disjunctions,  and 
negations  are  provided  as  a  part  of  the  system,. 


Use  of  Voice  Inp'Jt  ^n-i  Outout 


Tnn]  pmentcit  1  on  of  Voice  tnout  Uslna  the  VtP-lhh 

The  CHC  Svsterr  employs  a  VTP-ioo  voice  recognition 
device  which  is  caoable  of  recoqrUlng  64  utterances  of  duration  up 
to  two  seconds  earn,  when  trained  for  a  sneclflc  voice.  The  process 
Is  as  f o] lows . 


First  the  message  data  Is  Innut.  This  consists  of  up 
to  64  display  messages  of  up  to  16  characters  each.  Fach  of  the  64 
messages  must  havp  a  unldue  last  character,  since  only  the  last 
character  Is  transmitted  hy  the  vrp-ioo.  After  the  messages  have  been 
read  from  paoer  tape  or  typed,  the  ViP-ioo  is  trained  for  a 
particular  voice.  This  process  consists  of  the  VlP-ion  prompting  tpe 
person  by  displaying  a  message,  whereupon  the  person  speaks  the  wor<; 
or  Phrase  Into  the  microphone.  Usually  this  Is  done  5  to  lo  times 
for  each  of  the  messages.  After  all  the  messages  have  been  trained 
for  the  person's  voice,  a  recognition  phase  is  entered  In  which  the 
person  speaks  anv  of  the  64  messages,  and  the  VlP-mo  displays  the 
recognized  message  data  on  Its  16  character  display  screen.  If  the 
utterance  Is  not  recognized,  the  reject  lloht  win  be  turned  on. 
Individual  messages  maV  be  changed  or  retrained,  and  the  final 
acceptable  message  data  and  training  data  may  ho  output  on  punched 
tape  for  later  use. 


Fverv  tl'^e  utterance  is  received  and  recoonl^ed 

durina  the  reconnltlon  phase,  a  character  is  output  to  the  rnP-10  via 
the  PDP-15,  This  output  character  is  the  last  character  ot  the 
Ih-character  display  '"essaoe.  An  inverse  nrocess  in  the  PDP-io 
orooratTi  receives  the  character  and  retrieves  the  associated 
utterance , 

Table  ?  contains  a  list  of  the  utterances  currentlv 
used  in  CbC  deocnst rat  ions .  We  have  found  this  preliolnary  voice 
Innut  system  to  he  oulte  adeauate  for  our  current  demonstrations. 

The  eventual  speech  'ocoonitlon  system  employed 
the  rnc  system  will  incorporate  future  advances  in  machine 
recoanltion  of  nature!  lanauaoe#  uslm  acousttcs»  syntax,  semantics, 
discourse  analysis,  and  so  on.  Meanwnlle,  a  few  Incerim  Improvements 
are  Planned  in  the  current  viP-lhh  system, 

wp  will  develop  the  capability  to  store  messaae  ard 
tralninq  data  in  the  PDP"1h  and  transfer  it  fvia  a  PpP-ll)  to  the  ViP 
Without  havina  to  use  oaoer  tapes.  This  win  max.e  it  Possible  to 
have  a  laraer  input  vocabulary,  with  certain  key  words  Indlcatinq 
which  qro'ip  of  64  words  to  use  to  recoanlze  certain  utterances.  This 
will  also  make  it  possible  to  have  tralnlno  data  for  many  persons 
available  simultaneously,  oernans  with  automatic  selection  based  on 
recoanltion  of  a  few  samnie  utterances. 
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Inflection  values.  Phoneme  and 

inflection  are  under  the  control  of 

123 

1'^' 

/ 

J-'  y  L'-  ’.VC*  , 

thp  CBC  proaram,  in  addition,  ther#*  are  manual  controls  on  nltch, 
volurrp,  and  speech  rate,  Klnallv»  the  VOTR^X  Itself  contains  a 
bulit-ln  analysis  facility  that  emoiovs  nne  phoneme  look-anead  in 
order  to  make  the  continuous  speech  sound  more  natural  and 
Intell Inlhle,  The  result  Is  a  mechanicals  but  quite  understandable. 
Voice  to  use  for  output  in  the  demonstraton  proqrarrs. 


The  VHTRAX  consists  of  a  keyboard,  a  control  unit, 
and  a  speaker.  The  keyboard  is  used  for  manual  Input  of  phonemes, 
but  is  not  used  when  the  VOTRAX  is  under  computer  control.  The  VDTRAX 
Is  attached  to  the  PDP-IO  throuoh  the  teletype  patch  panel.  The 
computer  proqratr  sends  special  8-bit  codes  that  are  converted  by  the 
VOTRAX  control  unit  and  output  throuoh  the  speaker,  (A  future 
modification  to  the  VOTRAX  win  allow  It  to  share  a  teletype  line 
with  an  ordinary  computer  terminal.  This  will  be  an  added 
convenience,  out  will  not  chanae  the  operation  of  the  proaram.) 

The  current  use  of  the  VOTRAX  is  for  output  of 
orestored  utterances  (words  or  phrases).  Each  word  Is  represented 
Phonetically,  and  this  is  an  Interestlna  problem  In  Itself,  The 
VOTRAX  Is  deslqned  to  reproduce  Mid-Western  or  standard  American 

Endllsh  dialect,  which  Is  the  dialect  used  almost  exclusively  bv  the 
nationwide  media.  Still,  It  Is  a  skill  to  represent  words 
Phonetically  (and  It  Is  a  matter  of  opinion  as  to  how  well  a  olven 
word  has  been  represented!). 
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Table  3  contains  3  Tlstlno  of  the  h3  phonemes  with  an 
example  or  descrictlon  of  the  associated  sound.  It  should  pe  noticed 
that  some  typical  F'nollsh  sounds  (Ion  vowels,  for  example)  r'*auire 
two  Phonemes  to  reproduce  them.  Some  of  these  are  listed  In  Table  4. 


Table  3:  vniPAX  Phonemes  and  Kloht-Rit  Codes 


Phoneme 

Octal 

Tvpical  Use 

Symbol 

Code 

or  Oescrlntlon 

PAO 

03 

(cause ) 

PA  1 

It 

(Shorter  nause) 

A 

40 

(to  aet  lorn  A  sound  use  A,ayi 

A1 

06 

(shorter  than  A) 

^2 

05 

(shorter  than  Ai) 

5  6 

hat 

\F.l 

S7 

(shorter  than  AK) 

44 

hot 

(HI 

25 

(shorter  than  AH) 

kH2 

10 

(shorter  than  AHi ) 

iW 

75 

awful 

W1 

23 

(shorter  than  AW) 

(to  net  lonq  Q  sound  US'"  hhi  ,nn 
(snorter  than  Oi 
(Shorter  than  jn 


book 

(shorter  than  OGi 

Pot 

area 

see 

shv 

tea 

three 

then  (the  voiced  tH) 

(to  oet  lonq  D  sound  use  ILMi) 

(Shorter  than  in 

out 

(Shorter  than  UHi 
(shorter  than  Um ) 

(Shorter  than  IJH71 

seven 

Won 

i^ary 

(Y  used  as  a  consona'^t  as  Jn  "ves"! 
zero 

azure  (the  Z) 


measure  (the  51 


T^bl?  4;  Sounds  Fof'ned  with  Two  Phonemes 


Sound 

Typical  Use 

Phoneme  representation 

J 

let 

D,.T  or  nT,J 

CH 

match 

T,CH  or  DT,CM 

ow  or  nu 

cow 

A  H 1 ,  n  1 

01  or  OY 

nol  se 

01 

0 

queer 

K,W 

A 

name 

A,  AY 

E 

tree 

E  or  I  3, El 

I 

high 

AH, El 

height 

AH2,E1 

0 

note 

UM1 ,0! 

u 

tW(. 

A 


The  octal  ohoneme  code  Is  six  binary  bits  of 
information.  These  are  preceded  by  two  bits  representina  the 
Inflection  level,  in  'Tactlce^  the  inflection  code  is  represented  as 
eldht  bits  (with  the  last  six  belnq  zero)»  and  the  code  sent  to  the 
VOTRAX  Is  the  sum  of  Inflection  and  Phoneme  codes. 


Inflection  Levels  are 


T'  1 

.  ■' 

300 

( lowest  1 

2 

.  •• 

200 

(normai/defauitl 

3 

1  00 

r*  • 

'  • 


4 


ono 


(highest ) 


The  mm  code,  which  is  osed  for  fraDrlm  end  of  t ransrn  j  ss ion  to  the 
VOTPAX,  is  the  octal  code  377  (hinarv  11111111). 

To  date,  the  CBC  nrolect  has  used  aorroxi mate  1 v  ftoo 
phonetic  words.  Many  were  copied  from  a  list  snooled  by  the  VOTPAX 
manufacturer,  and  nearly  the  same  number  were  innut  by  various  users 
of  the  eciuipment.  A  LTSP  orooram  has  been  written  to  handle  the 
stori.'Q/  retrievinn,  and  transmission  of  Phoneme  reoresentations .  A 
few  typical  representations  are  reproduced  below. 

fPLtJASK  (2  P)fl  1,  )n  K)fl  F;i1(2  Z)) 

(ASSEMBLE  (7  UflDf?  p )  ( 7  EHn(2  M)(2  M)(2  R)f2  nH3)(2  L)^ 

(AIR  (2  AE)  ( 1  EP)  ) 

(COMPRESSnP  (7  K)f2  llMn(7  M)(7  P)(2  R)(7  EU)(1  S)(1  R)(l  R)) 

Addino  to  the  dictionary  Is  slmnle,  via  the  LISP 
function  ADhw.  An  example  is  explained  below. 

AT  nwf TESTING) 

This  line  Is  typed  by  the  user. 

TESTING: 

This  line  is  typed  by  the  profjram  which  then  waits 
for  the  user  to  respond  with  the  list  of  Inflection  and 
Phoneme  pairs. 

2T  2FH  3S  2T  ING  ]UH3 

The  user  inputs  a  try  at  the  Phoneme  r eor esentat 1  on . 

The  VOTPAX  pronounces  the  input  strlno,  then  the  pronram 
types  OK?  and  waits  for  user  response. 


1 


The  user  has  a  choice  of  four  possible  responses. 

If  the  user  types  Y,  the  word  wm  be  accepted  In 
its  present  phonetic  fore.. 

If  the  user  tyoes  R,  the  word  win  be  spoken  aoaln. 

It  the  user  types  N,  the  word  is  not  acceptable  and  a 
new  list  of  phonemes  must  b<»  Ircut, 

If  the  user  types  F.,  the  word  is  not  acceptable  hut  the 
user  Is  allowed  to  edit  the  preylous  list  of  phonemes. 


This  process  recycles  until  the  user  types  "Y",  at  which  time  the 
word  Is  added  to  the  dictionary  list  and  stored  in  the  special  data 
space  described  below. 


The  storaoe  of  phoneme  representations  of  words  makes 
use  of  LISP'S  ability  to  swap  data  Into  an  Inferior  fork.  In  this 
case,  we  use  the  fork  Into  which  IiISP  swaps  complied  code.  The  space 
for  the  Phoreme  data  is  a  lame  swapped  array.  Phoneme  and  Inflection 
pairs  are  stored  four  to  a  wor.l,  and  a  pointer  Is  kept  of  the  address 
of  the  last  phoneme  stored.  When  a  new  word  Is  to  be  stored,  the 
pointer  Is  incremented  by  1,  the  value  of  the  pointer  Is  stored  In 
the  system  hash  array  In  the  hash  address  for  the  word,  and  the  R-hlt 
codes  are  stored  with  an  additional  leadlno  "O"  (makina  9-blts  eachi 


sequential J y  Into  the  swapped  data  array.  The  last  code  stored 
contains  a  "1"  In  the  left  most  bit,  slnnallnq  that  the  end  of  the 


word  representation  has  been  reached. 


-■■T-,,  a  'voin  Lo  OP  spp<en,  the  "handle"  to  the 
nhonene  represenfat Inn  Is  obtained  by  G^TH ASH (word  1  and  the  list  of 

Dhoneme  codes  is  retrieved  from  the  swaoped  data  space  and  put  into  a 
buffer  (a  LISP  array)  to  he  sent  to  the  votrax.  The  capacity  of  the 
buffer  is  34  i<ords  or  136  Phonemes.  A  pointer  is  tcePt  to  the  current 
end  of  data  in  the  buffer,  and  many  words  and  nhrases  may  be  stored 
Into  the  buffer  before  they  are  actually  transmitted.  Transmission 
to  the  VOTRAX  (across  the  teletype  lines  by  the  TFWFX  operation 
system)  taVes  Place  either  when  the  buffer  Is  filled,  or  v.hen  the 
oronram  determines  that  no  more  words  are  to  be  utterred.  The  end  of 
transmission  Is  slonalled  to  the  VoTRaX  by  placlno  a  code  "377"  at 
the  end  of  the  data  in  the  huffer.  The  VHTPAX  itself  has  a  buffer. 
Voice  output  Is  Initiated  by  the  VotRaX  when  Its  buffer  Is  half  full. 
Thus,  It  IS  Possible  to  send  a  second  tranSMission  to  the  VOTRAX 
before  the  buffer  Is  completely  empty,  maicina  continuous  speech 
Possible. 

Provision  Is  made  for  savino  and  Testorino 
dictionaries  so  that  phoneme  representations  must  only  he  Input  once. 
The  MSP  functions  MAKFriCT  and  LOADPICT  accomoHsh  this  task.  They 
dePend  on  a  list  of  words  b^ina  saved  as  the  value  of  the  LISP  atom 
called  "PICT".  (In  demonstration  proarams.  we  freouently  set  PICT  to 
NIL  to  save  the  space  required  to  link  an  the  dictionary  words  into 
a  single  list.  This  means,  however,  that  we  cannot  save  an  nodated 
version  of  the  dictionary;  but  this  is  not  usually  a  hindrance.)  Tn 
the  case  of  MAKFPTCT.  a  disk  file  Is  opened,  and  each  word  on  PICT  is 


written  on  the  file  with  Its  correspondim  Phoneme  list  (not  the 
binary  f orff'--r athPf  the  forr^  that  exollcltly  contains  Infipctlon 
numbers  an<1  Phonenips),  Li'AnoTCT  operates  Jn  reverse*  ooenlnn  a 
specified  disk  file  for  Input*  reading  sequential  entries*  convertlno 
Phonemes  and  Inflections  to  binary  codes*  and  storlna  them  i^  the 
swapped  data  area. 

The  use  of  computer  voice  output  has  been  very 
satisfactory  in  all  the  demonstrations  wp  have  conducted  thus  far.  wp 
intend  to  continue  to  use  the  VOTHAX  for  the  forseeahie  future. 
Refinements  will  bp  made  in  the  representations  of  exlstina  words  and 
new  words  wm,  of  course*  be  added.  A  program  win  be  written  that 
will  attempt  to  make  its  own  Phonetic  representation  of  a  new  word. 
Another  new  program  will  provide  tor  dynamic  lnflec»:lon  of  a  whole 
utterance*  which  win  be  a  great  improvement  over  the  current  method 
of  orestorlna  the  Inflections  for  each  Individual  word, 

F.  System  Integration 

The  ultimate  form  of  the  Computer  Rased  Consultant  is 
expected  to  be  a  single  comouter  nrogram  which  may  be*  in  fact*  a 
combination  of  manv  different*  put  interlinked*  computer  programs. 
The  system  building  task  Is  a  bla  and  important  one  and  there  are  few 
precedents  or  theories  for  how  to  do  it.  The  main  philosoohy  that  has 
guided  system  building  of  the  CBC  up  to  now  is  that  as  different 
programs  and  "abilities"  become  available  (even  if  tbev  are  only  In 


nrellirlnary  or  slmrle  form)  thov  are  Included  m  the  system  as  soon 
as  possible,  Ttfls  anrroach  h^s  several  advantaoes. 

The  m.iin  advantaoe  Is  that  we  can  aet  a  "flavor"  of  what  the 
eventual  system  win  be  like.  For  example,  an  earlv  system  was  lust 
the  procedural  net  nrooram,  expanded  with  air  compressor  semant^.-s 
^'nd  icnowiedcie  about  tools.  [t  soon  became  apparent  that  voice  innut 
and  output  would  be  "nice",  so  that  was  added  by  taklno  advantane  of 
available  devices  that  use  oreseiected  words  and  nbrases  for  innut 
and  outout, 

Thlnos  that  are  seen  as  deficiencies  by  casual  observers  of 
the  demonstrations  are  taken  as  important  next  steps  for  the  system 
builders  >  For  example,  it  soon  became  npparent  that  many  niiestlons  an 
aoDrentlce  would  lodically  ask,  such  as  why?,  where?,  what  if  ...?  , 
and  so  on,  could  not  be  handled.  The  mechanisms  for  a  few  of  these 
were  coded  in  rudimentary  form  so  that  their  effects  could  be  tested. 

Another  important  consequence  of  continual  system  buiidlnq  is 
learnlno  where  different  parts  of  the  system  overlap.  For  example. 
Several  different  "models"  are  already  m  use  CI.e.,  a  connectivity 
model  for  deductive  question  answerlna,  and  a  oolvhedral  model  for 
qraphlcal  display  and  nolntlnq).  w©  must  ask  whether  the  models  can 
be  Combined,  Are  tpev  compatible?  Can  all  models  he  kept  up-to-date 
simultaneously  without  too  much  trouble?  vh*»re  can  one  proqram  oet 
information  from  another  nroaram's  model? 


In  summary'  the  current  CAprll  system  has  the  followlnn 

capabilities; 

(1)  It  knows  about  top  level  components  of  a  specific  air 
compressor , 

(2)  It  knows  about  some  basic  hand  tools  (screwdrivers, 
wrenches,  alien -wrenches)  snd  fastenlnos  (screws, 
machine-screws,  nuts  and  bolts,  set-screws,  washers), 

(3)  It  knows  about  assembly  and  disassembly  sequences 
(Posltlonlna,  connectlno,  fastenlm,  removlnq,  extractlna) 

(4)  It  kno*-'  about  parts  adjacent  to  other  parts,  both  In  the 
connectivity  (assembly/dlsassembly)  model  and  in  the 
polyhedral  (araphlcs)  model, 

(5)  It  can  use  a  laser  beam  to  point  at  the  location  of  a  part 

(6)  It  can  determine  which  Part  Is  indicated  by  a 
llaht/pointer  or  laser  beam, 

(7)  It  can  use  yolce  Incut  and  output  In  a  simple  form, 

(8)  It  can  create  Plans  for  accomol I shina  tasks  and  answer 
Questions  about  the  plans, 

(9)  It  can  execute  the  Plan  (i,e,,  tell  a  user  how  to  Perform 
a  task  at  leyels  of  detail  based  on  the  user's  varylnq 

responses ) , 

(10)  It  can  answer  Questions  about  the  chanaed  state  of  the 
equipment  at  any  time, 

(11)  It  can  perform  simple  execution  monltorlnq  of  the 
proqress  of  the  apprentice  In  executlno  a  plan. 


(12)  It  can  rertor^  cailbratlcr  ot  thp  laser-ranapf j ndpr  and 


thp  TV  camera  In  a  spwj  =>i)to'>’at  1  c  mode. 


This  is  an  impressive  list  of  caPahlllties  for  a  rroqram  that 
Is  still  In  Its  early  staaes,  F.ach  of  the  capabilities  needs  more 
development,  and  certain  Important  capabilities  are  Included  only  in 
rudimentary  form  (such  as  execution  monltorinq,  natural  lanauaoe,  and 
vision).  Still  other  capabilities  such  as  troubleshoot Ina  are  not 
Included  at  all.  Yet,  bv  malcino  an  Intenrated  system  out  of 
available  parts  we  are  able  to  envision  the  final  system  much  more 
readily  and  recoonlze  where  our  efforts  should  he  directed. 

The  "top  level  executive"  or  driver  proiram  for  this  system 
Is  expected  to  be  the  execution  monltorino  Portion  of  the  procedural 
net  (NOAH),  because  this  Is  the  pronram  that  carries  on  the  basic 
Interaction  with  the  user.  This  may  be  closely  associated  with  the 
eventual  speech  understandlno  pronram,  with  the  semantic  net  model 
becomlnq  one  of  the  prlmarv  sources  of  Information  about  the  task 
(and  world)  domain. 


The  system  Is  currently  implemented  by  taklno  advantaoe  of 
the  fork  structure  under  the  Tknf:x  ooeratlnq  system.  The  main 
Droqrammlna  lanauaqes  are  Lisp  and  qlisp,  wjth  use  -of  SAIL,  FORTRAN, 
and  machine  lanouane  where  aoproprlate.  The  fork  structure  Is  shown 


In  Flaure  1h, 
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FIGURE  16  STRUCTURE  OF  THE  CBC  DEMONSTRATION  PROGRAM 
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COMPnNfTM'S  nr  shhsfoufnt  systfm.'^ 


A.  Introduction 


in  parallel  with  ronstructlna  the  oresent  system,  we  nave  put 
In  a  qreat  deal  of  desion  work  on  components  of  future  (‘PTh  thr mqh 
l‘»78)  CMC  systems.  In  Section  IIT.H  we  oresent  a  detailed  description 
of  our  work  to  orovlde  a  powertul  natural  lanoijaqe  understandlnq 
system.  Our  Intention  Is  that  heolnnlna  In  107ft  we  will  he  able  to 
orocess  some  text  Innut  to  the  svstem,  (Th-'  text  input  system  is 
helna  deslaned  to  be  part  of  a  system  that  will  ultimately  handle 
speech.)  ourlno  1977  we  olan  to  make  extensiye  additions  to  the  power 
of  the  text  system,  and  finally  In  1978  we  expect  to  extend  It  to 
handle  utterances  spoken  oy  the  apprentice,  Gary  Hendrix  and  Barbara 
Deutsch  have  been  responsible  for  our  natural  lanouaoe  research 
worklnq  in  conlunctlon  with  the  SRi  speech  understandlnq  prolert. 


In  Section  ITI.C  we  describe  two  pieces  of  additional  problem 
solvlna  Work,  First  we  nresent  some  research  Performed  bv  Marty 
Rattner  on  how  to  model  and  compute  the  "freedom  of  movement" 
Properties  of  equipment.  Ngxt  we  dtscuss  the  Preliminary  results  of 
Richard  nuda  and  Mis  Mlsson  toward  bulldlna  a  system  for  dlaonosls 
of  equipment  malfunction. 
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O'lr  work  In  vision  Is  described  In  Section  TlT.n.  Tt  win 
ulttirateiy  orovlde  the  capahiilty  of  answerlno  ouestions  about  the 
equipment  and  the  workstation  by  direct  observation.  The  vision  work 
represents  the  combined  efforts  of  several  people,  notably  Martv 
Tenenbaum,  Harry  Harrow,  and  Thomas  Garvey  (dolnq  Ph.O.  dissertation 
work) . 

B,  Natural  Language 

1,  Introduction 

The  goal  of  our  work  In  language  Is  to  provide  a  two 
way  communications  link  between  the  consultant  and  the  apprentice 
that  Is  both  natural  and  convenient.  We  are  persuaded  that  the  most 
appropriate  communications  medium  is  that  of  spoken  Fngilsn.  The 
reason  for  this  Is  twofold.  First,  speech  trees  the  apprentice  from 
the  purdens  of  Interacting  mechanically  with  the  consultant  wniJe 
performing  his  tasks,  aecond,  the.  use  of  Fnglish  makes  It 
unnecessary  for  the  apprentice  to  cope  with  a  formal  language,  thus 
allowing  him  to  concentrate  all  his  efforts  on  the  performance  of  the 
work  task.  It  is  anticipated  that  by  1978  the  languige  component 
will  have  the  ability  to  understand  the  user's  spoken  questions  and 
remarks  regarding  the  state  of  his  task  and  •  the  use  of  tools. 
Further,  the  system  will  have  the  ability  to  produce  spoken  responses 


to  verbal  Inputs 


in  developing  a  tecnnology  tor  the  understanding  of 
continuous  speech#  our  research  efforts  are  being  carefully 
coordinated  with  those  of  the  SRI  speech  project  [36],  As  a  result 
of  cooperation  during  the  past  year#  a  common  oaslc  grammar  and  a 
common  semantic  Interpretation  system  have  been  developed.  Further# 
the  focused  parser  desloned  for  the  speech  project  has  been  adapted 
for  (Interim)  text  processing  by  the  CBC,  vJhlle  various  acoustic 
processing  techniques  are  being  developed#  this  parser  win  allow  us 
to  conduct  experiments  during  the  next  two  years  using  text  and  win 
facilitate  the  eventual  conversion  to  acoustic  input  in  1978, 

In  keeping  with  the  goal  of  providing  natural 
communications  between  consultant  and  apprentice#  we  have#  during  the 
last  year  and  a  half#  collected  and  analyzed  numerous  protocols 
between  human  consultants  and  apprentices,  within  the  past  year#  this 
analysis  has  aided  us  In  the  selection  of  a  working  vocabulary  and  in 
the  development  of  a  tentative  performance  grammar  (which  extends  the 
grammar  developed  Jointly  with  the  speech  project).  Having  used  the 
protocol  experiments  to  clarify  the  language  requirements  of  a 
computer  based  consultant#  we  have  been  developing  a  system 
architecture  and  a  semantic  representation  scheme  capable  of  dealing 
with  the  linguistic  problems  llicely  to  arise  In  consulting 
situations.  Details  concerning  each  of  these  achievements  follow. 
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Protocol  Collection 


We  have  extended  the  collection  oi  protocols 
described  in  our  previous  annual  report  1373  to  inciuoe  ditterent 
tasks  and  apprentices  at  different  skill  levels.  One  nei*  task  has 
entailed  working  on  a  siiocomponent  of  t  ne  compressor#  namely  the 
pump.  This  task  Introduced  new  vocabulary  and,  more  Importantly#  the 
need  to  describe  and  understand  questions  about  more  complex  tools# 
parts,  and  operations,  A  sample  from  one  of  tne  pump  assembly  dialogs 
Is  shown  In  Figure  17. 

We  have  an  experimental  setup  now  that  allows  us  to 
record  new  protocols  easily,  we  plan  to  run  additional  experiments  on 
new  pieces  of  equipment,  Tasxs  for  these  experiments  will  entail 
troubleshooting  as  well  as  assembly  and  disassembly, 

3#  The  Concordance  Programs 

As  an  aid  to  our  analysis  of  the  language  used  In 
exper t/apprentice  situations#  we  have  developed  a  package  ot 
concordance  programs,  A  sample  output  from  these  programs, 
Illustrating  several  of  the  features  of  tne  concordance  produced#  is 
Shown  In  Figure  18,  This  sample  shows  a  collection  of  results  from 
concordances  done  separately  for  several  dialogs.  (The  dates  were 
added  to  make  the  separation  clearer,)  For  each  of  the  that  which 
occur#  the  concordance  snows  a  frequency  count  and  a  list  of  the 
different  contexts  In  which  that  word  appears. 
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Knowing  the  context  In  which  a  word  appears  aids  In 
determining  both  the  different  semantic  and  the  different  syntactic 
uses  of  the  word,  i^/e  have  used  this  Information  In  constructing  our 
Working  concepts  and  our  working  grammar.  By  pulling  all  of  tpe  uses 
of  a  word  together#  the  concordance  enables  us  to  determine  which 
word  senses  are  used  most  often.  It  would  be  difficult  to  get  this 

same  information  from  the  raw  dialog  because  the  word  uses  are  so 
spread  out.  As  an  example#  consider  the  uses  of  the  word  "all"  shown 

at  the  top  of  Figure  18,  These  are  representative  of  the  uses  we 
found.  In  only  one  case  Is  "till"  used  In  the  quant  1 f icatlona 1 
sense  (in  the  FEB12  dialog#  ",  ,  .  I've  got  all  four  bolts  In 
place').  This  result  (and  similar  ones  tor  the  other  guantlf lers)  was 
unexpected , 
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us 
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total 
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use.  We  have  used  this  to  distinguish  expert  and  apprentice  word 
uses.  For  example  (see  Figure  18)  the  use  of  "bolt"  as  a  present 
tense  verp  comes  exclusively  from  the  expert.  The  apprentice  uses 
the  Verb  form  of  bolt  only  In  the  past  tense. 

It  Is  possible  to  merge  the  concordance  results  for 
several  dialogs.  We  have  obtained  a  merged  concordance  for  all  of  the 
dialogs#  which  enables  us  to  distinguish  indivic  ai  differences  from 
general  trends.  Those  words  and  syntactic  structures  that  appear 


across  several  dialogs  are  incorporated  in  our  working  vocabulary  and 
working  grammar.  Later»  individual  modes  of  expression  will  be 
handled  in  the  user  model. 

4.  Dialog  Analysis 

As  mentioned  previously,  a  major  motivation  in 
the  dialog  protocols  has  been  to  determine  the  language 
reguirements  of  the  CBC.  Analysis  of  the  collected  dialogs  has 
proceded  on  several  levels.  On  the  most  basic  level,  we  have  used 
the  protocols  in  establishing  our  working  vocabulary  and  grammar. 
These  are  discussed  more  fully  in  separate  sections.  In  both  these 
Undertakings,  analysis  ot  the  dialogs  aided  us  not  only  by 
illustrating  what  language  usages  there  were  but  also  by  making  us 
aware  of  what  problems  did  not  arise.  For  example,  as  noted  before, 
we  were  surprised  by  the  Infreguent  use  of  guantif ication  by  the 
apprentices.  Quantifier  words,  like  "all",  did  appear  in  apprentice 
statements,  but  mainly  in  phrases  like  "is  that  all"  meaning  "have  I 
f Inished?" . 


There  are  many  well  known  discourse  level  problems  in 
natural  language  understanding?  for  example  the  problems  of  resolving 
reference  and  completing  partial  utterances.  In  the  CBC  domain  there 
are  also  the  closely  related  problems  of  describing  and  understanding 
descriptions  of  objects  and  actions,  we  have  been  using  the  dialogs 
as  guides  for  our  research  on  these  more  global  discourse  level 


problems . 


We  have  been  Interested  not  only  in  the  forms  of 
these  CBC  discourse  level  problems,  but  also  In  dlscoverlna  what 
Inherent  Information  there  was  In  the  dlaloq  context  that  would  aid 
In  "solving"  the  problems. 

The  dialog  context  Is  actually  a  composite  of  three 
different  component  contexts;  a  verbal  context,  a  task  context,  and 

a  context  of  general  world  knowledge.  The  verba)  context  Includes  the 

history  of  preceding  utterances:  their  syntactic  form,  the  objects 

and  actions  discussed  In  them,  and  the  particular  words  used.  The 

task:  context  is  tne  focus  supplied  by  the  tas<  oelhg  worked  on.  It 

includes  such  things  as:  wneis  does  che  current  subtask  fit  In  the 

overall  plan#  what  re  its  subtasks#  what  actions  are  likely  to 

follow,  and  what  objects  are  Important,  The  context  of  general  world 

knowledge  is  the  information  that  reflects  a  background 

understanding  of  the  properties  and  interrelations  of  objects  and 

actions;  for  example#  the  fact  that  tool  boxes  typically  contain 

tools  and  tnat  attarning  involves  some  kind  of  fastening. 

An  Important  aspect  of  the  reference  problem  is 
determining  what  sources  of  knowledge  should  oe  accessed  to  resolve  a 
reference.  Decisions  must  be  made  concerning  how  much  effort  may  be 
spent  testing  one  antecedent  candidate  and  how  much  effort  may  be 
spent  Investigating  the  different  context  perspectives  from  which 

that  candidate  may  be  viewed. 
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In  the  context  ot 


"Tighten  the  setscrews  with  an  alien  wrench" 

conslc^er  the  question 

"Where  are  the  setscrews?" 

The  phrase  "the  setscrews"  must  be  resolved  as  the  previously 
mentioned  ones,  T»'ls  resolution  comes  from  the  verbal  context  (or 
dialog  history).  However#  In  the  context 

"Attach  the  pump  pulley  next" 

the  question  "Where  are  the  setscrews?"  can  only  be  understood  If 
the  consultant  Is  aware  that  Installing  and  tightening  some  screws  is 
part  of  the  operation  of  attaching  the  pump  pulley.  The  resolution 
comes  from  knowledge  of  the  task.  Any  screws  mentioned  In  the 
previous  dialog  would  probably  be  irrelevant.  Finally#  if  we  consider 
the  context 

"I  have  the  parts  box," 

the  resolution  can  be  found  only  by  knowing  that  screws  are  typically 
stored  In  a  parts  box. 


The  reference  resolver  must  consider  as  candidates 
for  antecedent  not  only  oojects  and  actions  that  are  explicitly 
represented  In  the  dialog  history  (which  would  work  only  for  the 
first  of  our  examples),  but  also  the  Interconnections  of  those 
objects  and  actions  In  the  task  domain  and  In  the  "qeneral  real 
world".  This  means  deciding  whicn  Kinds  of  connections  to  consider 
first  and  how  long  to  Investigate  them  before  looking  at  others.  It 

also  entails  deciding  how  much  effort  to  put  Into  looking  at  all  the 
connections  of  one  oblect  or  action  before  considering  others.  The 
Implementation  of  the  reference  resolver  is  being  designed  so  that  we 
can  easily  experiment  with  olfferent  strategies  for  looking  at  the 
various  contexts.  The  separation  between  the  three  context 
components  is  made  explicit.  The  task  context  is  supplied  by  a 
connection  to  the  procedural  net.  The  difference  between  the  local 
Verbal  context  and  real-wgrld  knowledge  connections  is  reflected  in 
the  way  the  semantic  representation  of  the  discourse  history  Is  kept. 
Essentially,  the  local  context  is  kept  separate  from  global 
knowledge,  but  contains  a  few  links  to  that  knowledge.  How  this  Is 
done  will  be  discussed  more  fully  after  the  semantic  representation 
Is  presented. 

The  problem  of  object  description  Is  closely  related 
to  the  reference  problem.  This  is  obvious  since  the  description 
problem  Is  basically  the  Inverse  of  the  reference  resolution  problem; 
an  Object  Is  unambiguously  described  If  the  description  given  can  be 
used  to  locate  a  unique  object.  Any  object  has  a  multitude  of 


attributes 


Some  are  simple  (e.g.»  color,  shape)  and  others  involve 


connections  to  other  objects  (e.q.,  on-top-of,  Inside).  However,  at 
any  one  tine  only  a  few  of  these  properties  are  needed  to  uniquely 
specify  tne  object.  This  is  because  context  limits  tne  other  objects 
from  Which  any  one  object  needs  to  be  distinguished.  As  an  examnie, 
consider  the  situation  when  the  apprentice  is  using  a  1/2-inch 
box-end  wrench  and  a  l/2-lnch  socket  wrench  to  tighten  a  nut/bolt 
fastening.  The  two  wrenches  may  be  distinguished  by  type:  "the 
wrench"  is  ambiguous,  but  both  "the  box-end  wrench"  ar.d  "the  socket 
wrench"  are  unambiguous.  However,  if  the  aoprentice  is  using  two 
1/2-inch  box-end  wrenches  for  his  task  then  they  need  to  be 
distinguished  by  other  criteria,  such  as  which  Is  on  the  nut. 

We  have  been  designing  the  discourse  history 
component  of  the  system  in  a  way  that  will  allow  us  to  know  which 
attributes  of  an  object  are  most  Important  in  a  given  context.  Again 
this  is  closely  tied  to  the  semantic  representation  and  win  be 
discussed  in  Section  9  below, 

5,  Selection  of  working  Vocabulary  and  Working  Concepts 

The  concordance  programs  have  aided  us  In  finding 
Which  words  are  likely  to  occur  in  the  workstation.  Surprisingly, 
only  f>20  different  words  were  used  in  all  of  the  dialogs,  Uur  initial 
working  vocabulary  of  approximately  650  words  includes  some 
additional  words  Ke  know  will  appear  as  new  tasks  are  added  Ce,g,, 
Some  part  names), 
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4. 


s  a  tirst  step  toward  b'Jllalnc7  a  semantic 
representation  of  the  Knowledge  base  necessary  to  unaerstand  CBC 
related  dlaloas,  we  have  divided  the  vocabulary  Into  conceptual 
categories.  (Our  semantic  representation  Is  discussed  In  Section  R 
below.  For  present  purposes,  it  suffices  to  Know  that  oblects  and 

actions  are  represented  by  nodes  In  a  semantic  network.  Various 
hierarchical  relationships  between  categories  of  objects  and  actions 

are  also  represented.  In  addition.  It  Is  Important  to  Know  that  the 
result  of  parsing  an  utterance  is  the  production  of  a  semantic 
network.)  At  present  there  are  21  conceptual  categories.  The 
categories,  along  with  a  sample  of  the  words  in  each  category,  are 
Shown  In  Figure  19. 

There  are  several  character istlcs  of  tnls  category 
list  that  will  be  important  In  building  our  network  representation. 
First,  the  categories  are  hierarchical.  For  example,  in  the  category 
of  location  operators  there  are  general  Position  change  words  (e.g., 
adjust)  and  also  position  change  words  which  specify  that  a  tool  be 
used  (e.g.,  pound).  Note  that  some  of  the  nlerarchies  that  are 
Important  in  the  ChC  domain  are  not  shown  In  this  category  list, 
because  subclasses  are  not  shown  to  all  levels.  (To  do  tnls  would 
require  showing  the  compiete^semantlc  net),  l-or  example,  under  tools 
we  do  not  show  the  hierarchy  tool-^  wrench->  box-end  wrench. 

Note  that  some  of  the  categories  are  quite  closely 
related.  The  best  example  of  this  Is  the  set  of  categories: 
location,  location  operators,  locate.  The  location  category  contains 
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thos9  verdt  that  exprafi  the  dlffertnt  plactt  and  positions  in  whien 
•n  object  say  ba  found.  The  location  operators  are  those  words  that 
have  to  do  with  effecting  change  (or  no  change)  on  those  positions. 
The  words  in  the  locate  category  have  to  do  with  whether  or  not  the 
location  Of  an  object  is  known.  The  representations  corresponding  to 
the  words  in  these  categories  win  be  closely  linked. 

Xn  addition  to  the  categories  that  have  to  do  with 


objects  (e.g.*  tools)  and  actions  (e.g.*  fasten)  in  the  dowain.  there 
are  categories  that  have  to  do  with  expert/user  interaction  (those  in 
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the  communication  category).  The  presence  of  this  category  indicates 
the  importance  of  the  subtask  of  communicating  information  betwe^^n 
the  the  expert  and  the  apprentice. 


There  are  also  categories  that  in 
syntactic  structure  of  individual  utterances, 
operators  category  contains  that  which  will 
specific  representations  in  the  semantic  net. 


essence  concern  the 
The  linguistic 
not  themselves  have 
The  words  in  this 


category  help  guide  the  construction  of  the  semantic  representation 
being  oullt  up  for  an  utterance,  not  by  adding  new  semantic 
constituents,  put  rather  by  indicating  the  relationships  between 
existing  constituents.  For  example,  the  prepositions  help  supply  the 
mapping  between  surface  cases  and  deep  conceptual  cases. 


The  Working  Grammar 

Through  cooperative  efforts  with  the  SFI  speech 
project,  a  basic  Performance  grammar  applicable  to  a  wide  variety  of 
tasks  has  been  developed.  For  use  in  tne  CBC  domain,  certain 
extensions  to  this  basic  grammar  have  been  made  to  account  for 

syntactic  constructions  that  occur  with  higher  freguency  in 
consultation  dialogs  than  in  ordinary  conversations.  The  grammar  is 

based  on  a  thoughtful  analysis  of  our  protocol  exp,.r iments ,  and  thus 
reflects  a  major  portion  of  the  language  actually  spoken  by 
apprentices  in  the  performance  of  tasks  rather  than  some  abstract 
theory  of  how  the  apprentice  "should"  soeak.  Thus,  the  grammar  can 
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handle  isolated  phrases  and  clauses  as  well  as  complete  sentences. 
Although  It  reflects  the  language  of  this  task  domain#  the  grammar 
does  include  the  kinds  of  linguistic  constructions  handled  in 
contemporary  computational  linguistic  research  and  was  written  with 
extensibility  in  mind. 

Since  the  grammar  is  ultimately  to  be  used  in  tne 
processing  of  speech#  it  has  been  designed  so  that  advantage  may  be 
taken  of  knowledge  available  from  whatever  sources  are  capable  of 
reporting  Information  at  any  given  point  during  an  analysis.  The 
grammar  is  written  so  that  it  is  not  restricted  to  a  particular  kind 
of  parsing  strategy.  That  is#  it  can  be  used  both  bottom  up  in 
building  more  complex  grammatical  structures  from  words  that  have 
been  identified  acoustically#  and  top  down  in  working  from  predicted 
grammatical  structures  to  the  words  they  contain,  (The  same  grammar 
should  also  be  serviceable  for  response  generation#  although  not  much 
*tudy  has  yet  been  made  in  this  area,)  The  grammar  Incorporates  in 
its  rules  information  on  semantic#  pragmatic#  and  prosodic  features# 
as  well  as  on  grammatical  ones.  Experiments  conducted  by  the  speech 
group  (i6]  show  that  when  the  basic  grammar  is  compiled  with  a 
lexicon  into  the  Internal  representation  used  by  the  parser#  the 
result  is  a  language  processing  system  whose  sources  of  knowledge  are 
highly  Integrated  and  wv*ll  coordinated. 

Both  the  basic  grammar  and  the  CBC-speclflc 
extensions  are  expressed  as  collections  of  rules  (following  Paxton 


[38J).  As  exemplified  by  ( s Imp  1 1 1 led  and  edited)  rule  SI  of  Figure 
20»  a  ararntrar  rule  has  three  principal  components;  a  context-free 
production,  an  attributes  statement,  and  a  factors  statement.  While 
each  rule  contains  a  context-free  component#  it  must  be  emphasized 
that  the  rules  themselves  are  not  context  free,  since  the  application 
of  a  production  Is  constrained  by  restrictions  encoded  througn  the 
attributes  and  factors  statemi^nts. 


RULE.OLf  Sit 

CF-PPfJDUCTIC"'' 

S  *  ■'ip  VP; 

AT  TRIBUTK.S 

FOCUS,  FOOD  FPC  ’.  ,>ip, 

VCiICE  «  "ACT, 

SLFAMICS  s  SEFRSl  CSEMAMICS('-jP)  , 

SEVA'OTXCSCVP)  )  , 
AFFi'^EG  r  IF  MOOD  EQ  DEC  THEN  "AFF* 
FACTORS 

IF  VCICFfVP)  EC  PASS  THEN  OUT, 

IF  GINTERSECT  I  On  (  NBH  (  NP ) ,  f,‘RH(VP)) 

then  ok  else  out, 

IF  TPAnS(VP)  FO  0  IrlFiv  BAD, 

IF  SEMArTiCS  £0  NIL  THEN  'lUT; 

FIGURE  20  A  SIMPLIFIED  GRAMMAR  RULE 


The  context-tree  production  ot  a  orairmer  rule 
specifies  e  string  ot  utterance  constituents  (either  terminals  or 
tokens)  that,  under  tavorahle  circumstances,  mav  oe  comolned  to  form 
a  larger  or  more  complex  constituent.  For  example,  the  context-free 
production  of  rule  si  Is 


S 


NP  VP 


Which  Indicates  that  an  S  constituent  of  an  utterance  (a  complete 
sentence  or  clause]  may  be  formed  by  joining  an  imp  (noun  phrase)  with 
a  VP  (verb  phrase);  nowever»  various  attributes  of  the  nP  and  VP  must 
be  in  agreement. 

To  build  up  Internal  descriptions  of  parsed  phrases, 
each  rule  augments  its  context-free  production  with  an  attributes 
statement,  tach  constituent  type  (e,g,,  the  constituent  types  NP,  VP, 
S,  U  used  by  the  grammar  is  associated  with  a  set  of  attributes  whose 
values  help  to  characterize  particular  Instances  of  the  constituent. 
For  example,  the  attributes  VOICF  and  MOUD  help  to  characterize 
particular  instances  of  VPs  and  3s,  The  attributes  statement  of  a 
grammar  rule  assigns  values  to  attributes  of  the  phrase  being  built 
up.  These  values  are  derived  primarily  from  the  values  of  attributes 
in  the  phrase's  constituents.  Thus,  for  example^  the  FUCUS  and  MOOD 
of  an  S  constructed  by  rule  'il  are  tatcen  from  the  FOCUS  and  MOOD  of 
the  NP  that  is  the  first  constltutent  of  the  s.  Attribute-values 
for  the  most  primitive  components  of  the  grammar  (such  as  individual 
nouns)  are  specified  by  the  lexicon. 

To  constrain  the  application  of  rules  to  appropriate 
situations  and  to  aid  the  p^.fser  in  deciding  which  rules  seem  most 
likely  to  yield  good  results^  each  r 'le  contains  a  factors  statement. 
Since  a  given  context-free  production  is  applicable  only  if  Phrase 
subparts  are  compatible,  the  factors  statement  may  apply  tests  that 
examine  the  values  of  constituent  attributes  to  determine  their 


compatibility,  Kor  those  phrases  that  pass  the  compatibility  test^ 
the  factors  statement  derives  a  number#  called  the  rule  score#  which 
indicates  how  well  the  constituents  tit  todetner.  This  numoer  is 
used  by  the  parser  In  determining  how  much  effort  to  devote  to  uslno 
the  phrase  produced  by  the  rule  In  suosequent  computations. 

lo  use  a  rule  such  as  Si  in  the  Bottom  up  mode#  the 
parser  first  finds  a  string  of  the  form  "Np  vp"  to  match  tne  right 
side  of  the  context-free  production.  v.ltn  such  a  string  found#  tne 
Parser  begins  to  check  the  factors.  First#  a  check  is  made  to  see  If 
the  VUlCt  of  the  VP  Is  pass  (passive).  passive  voice  Is  not  allowed 
In  this  rule  (there  Is  another  rule#  S9  In  Figure  21#  that  should  be 
used  for  passives)#  and  hence  If  VQICE(VP)  is  In  fact  PASS#  then  this 
application  of  rule  si  is  thrown  OUT  and  a  record  of  the  aoorted 
application  Is  made  to  prevent  future  attempts,  if  the  voice  test  is 
passed#  then  a  test  Is  made  to  see  If  the  number  attributes  of  the  WP 
and  VP  are  compatible;  e.g.#  "tney  mesh"  is  OK  put  "it  mesh"  is  OUT. 
The  passing  of  this  compatibility  test  Is  regarded  as  a  moderately 
'^ood  sign  (indicated  by  "OK")  and  the  rule  score  becomes  slightly 
enhanced.  The  next  Portion  of  the  factors  statement  checks  to  see 
If  the  TPANS  of  the  VP  (the  number  of  yet  unasslgned  standard  case 
arguments)  is  o.  If  irans(VP)  is  in  fact  0,  this  Is  a  BAu  sign  and 
detracts  from  the  score  given  the  resulting  S  constituent. 

When  other  tests  are  passed#  the  Snf^ArtTlCS  attribute 
of  S  Is  computed  from  the  SEMANTICS  of  nP  and  VP  by  a  call  to  the 
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FIGURE  21  CONTEXT-FREE  PRODUCTIONS  OF  BASE  GRAMMAR 
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FIGURE  21  CONTEXT-FREE  PRODUCTIONS  OF  BASE  GRAMMAR  (ConclucM) 
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function  SEMRSl  ,  If  SEMRSi  returns  ML,  tne  rule  fans  on  semantic 
grounds.  Otherwise,  SEMRSl  returns  tne  semantic  Interpretation  of  S, 
and  the  other  attributes  of  S  are  computed  in  accordance  witn  tne 
attributes  statement  and  stored  with  the  completed  S. 


While  space  considerations  make  it  Impractical  to 
list  the  complete  grammar  in  this  document  (see  Ref,  3h  for  a 
complete  listing),  a  feel  for  the  extent  of  the  grammar  may  be  gained 
by  examining  just  the  context-free  productions  of  the  rules.  The  CFRs 
of  the  base  grammar  are  presented  in  Figure  21,  with  CBC  extensions 
in  Figure  22,  (A  base  rule  marked  by  "cbc"  (or  "speech”)  indicates 
that  the  rule  is  currently  used  primarily  by  the  CBC  (SRI  speech) 
project,) 


RULE 

CONTEXT-! REK-STATENENT 

S20 

S  s  NP  AUXH  PRFPP 

S21 

S  =  AUXB  NP  PREPP 

S22 

5  =  "WHERE  AUXB  NP 

S23 

S  =  PEL  S  REL  =  that, 

Which 

S24 

S  =  SEOWn  W  SEQuence  worn  =  now. 

next,  first 

S25 

S  =  SEQWD  S 

S26 

S  =  SUBORDS  S 

S27 

S  =  S  SUBORDS 

Example:  iurn  the 

bolt 

unt  i  1 

It's  tight. 

S28 

S  r  S  "PLEASE 

S29 

S  =  "PLEASE  S 

SUBSl 

SUBORDS  =  SUbCONJ  S  5UHC0NJ  =  wpePf 

until,  so  that 

NP18 

NP  =  Np;NPl  COORD  Mp:rjp2 

.  CORO  = 

and, or 

NPl 

NP  =  NP:NP1  comma  NP;'.'R2 

N0M3 

NOM  =  NOM;NO'v’1  "And  NONKNOM? 

FIGURE  22  CBC  GRAMMAR  EXTENSIONS 


The  Parser 


The  SKi  speech  group  has  developed  an  experimental 
parser  that  Is  specifically  deslqned  to  coPe  ^fith  the  variapiuty  of 
pronunciations  and  the  frequent  lacK  of  separations  between  words 
that  characterize  spoken  lanauage.  To  take  advantage  of  knowledge 
about  the  input  stream  from  any  sources  that  are  available^  the 
parser  is  alloweq  to  (simultaneously)  work  both  top  down  and  bottom 
op»  predicting  words  and  Phrases  on  the  basis  of  context  and  building 
up  Phrases  and  clauses  from  words  that  have  been  identified  in  any 
position  in  an  utterance.  Using  information  from  many  sources^  the 
parser  coordinates  knowledge  relating  to  the  structure  of  tnglish, 
the  natuie  of  cne  task  being  performed*  the  conversation  context*  the 
prosodic  features  of  the  input*  and  so  on.  Since  the  uncertainty  of 
the  input  and  the  variety  of  kinds  of  knowledge  required  can  lead  to 
consideration  of  a  large  ranoe  of  Interpretations  in  the  analysis  of 
an  utterance*  the  parser  contains  mechanisms  that  enable  it  to 
examine  the  most  reasonable  alternatives  first  and  to  focus  its 
activities  with  respect  to  both  processing  time  and  available  space. 
(A  full  description  of  the  parser  is  contained  in  Ref,  36.) 


To  facilitate  the  conversion  to  spoken  input  in  197B* 
we  are  designing  our  interim  text  processor  to  be  as  nearly  like  the 
proposed  speech  processor  as  possible.  Toward  this  end*  the  speech 
parser  has  been  modified  to  accept  text  input.  Although  a  simpler 
parser  could  oe  written  to  do  text  processing  exclusively*  py  using  a 
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modified  speech  parser  in  the  interim,  the  eventual  conversion  to 


spoken  input  will  entail  no  interface  cnanoes  between  the  parser  and 
the  CBC-specific  systems  with  which  the  parser  communicates.  Both 
the  CBC-specific  systems  that  communicate  with  the  Parser  and  the  CBC 
grammar  may  be  written  and  tested  in  text  mode.  Further,  the 
text-based  system  will  serve  as  a  useful  tool  for  testlna 
task-or lented  input-prediction  strategies  that  wiii  be  needed  to  help 
guide  the  parser  through  spoken  consultation  dialogs, 

8,  System  Design 

Since  the  language  system  must  be  coordinated  with 
other  components  of  the  CbC,  we  have  attempted  to  temper  our  work  in 
protocol  analysis  and  in  the  development  of  a  semantic  representation 
by  keeping  in  mind  the  Interactions  that  must  occur  between  the 
language  system  and  various  knowledge  specialists  in  the  CBC.  To 
better  understand  the  intercommunications  problems,  we  nave  developed 
tentative  system  designs  at  two  levels. 

The  most  abstract  design,  shown  in  Figure  2i. 
interprets  the  language  component  as  the  interface  between  the  user 
and  a  group  of  task  specialists.  According  to  this  model,  the 
language  component's  Mediator  handles  interactions  with  the  user  and 
with  various  subsystems  that  are  highly  competent  in  the  performance 
of  restricted  and  specialized  tasks.  In  interacting  with  the  user 
and  the  task  specialists,  the  Mediator  receives  help  from  a  user 
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FIGURE  23  ABSTRACT  LANGUAGE  SYSTEM  DESIGN 


model  and  a  task  model.  The  user  model  encodes  the  discourse 
history,  the  state  of  the  user's  progress  in  the  Performance  of  some 
task,  and  Information  concerning  other  characteristics  (e.g., 
acoustic  parameters  and,  eventually,  problem  solving  style)  of  the 
current  user.  The  task  model  contains  abstract  descriptions  of  the 
task  specialists'  capabilities  and  of  the  tasks  that  the  user  himself 
can  perform.  Both  the  user  model  and  the  task  model  help  the 
Mediator  understand  the  user's  utterances  (principally  by  providing  a 
context  for  the  resolution  of  anaphora  and  ellipses).  The  task  model 
helps  the  Mediator  decide  which  task  specialist  to  Invoke  In  seeking 
to  respond  to  a  user's  queries. 
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At  the  more  concrete  level  of  roftware  modules/  ne 
are  v^orking  with  the  system  design  of  Figure  24  In  mind.  In  this 
figure,  double-lined  arrows  represent  floA  of  control#  solid  arrows 
represent  flow  of  Information#  and  hroKen-l Ine  arrows  represent 
subroutine  calls.  According  to  this  system  design#  control  is  first 
resident  In  the  parser  which  receives  data  from  the  arammar  and  the 
lexicon  (and#  of  course#  from  the  user).  ir  the  course  of  its 
operations#  the  Parser  is  expected  to  call  on  the  Composition 
Semantics  Subprocessor#  which  builds  up  semantic  interpretations  of 
parse  fragments.  To  perform  the  semantic  interpretation#  the 
Composition  Semantics  may  request  information  from  the 
Pragmatics/Discourse  unit  or  from  the  data  base  (through  the  Data 
Base  Controller), 


Unce  a  semantic  Interpretation  of  a  complete  input 
has  been  ccnstructed#  It  Is  passed  to  the  Bequest  Server,  Since  the 

CBC  cannot  carry  out  physical  commands#  user  Inputs  are  either 
requests  for  information  or  statements  of  tact  for  the  system  to 
commit  to  memory  or  use  in  updating  Its  model  of  the  task  being 
performed.  In  either  case#  the  Bequest  Server  calls  the  Data  Base 
Controller#  which  may  input  new  data  into  the  data  base  (and 
indirectly  cause  updating-monitoring  demons  to  be  fired  off)#  or  may 
query  the  data  base  (and  perhaps  indirectly  •  invoke  knowledge 
specialists#  such  as  the  planner#  that  derive  pieces  of  data  not 


specifically  encoded  in  the  data  base) 
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When  an  appropriate  response  has  been  determined  by 
the  Pequest  Server,  the  response  is  passed  either  to  the  lanquaqe 
generator  (v»(hlch  produces  spoken  output),  to  the  physical  generator 
(Which  provides  a  mechanical  output  such  as  the  pointing  ot  the  TV 
camera  or  the  laser),  or  to  both. 

The  relationship  between  the  software-module  system 
design  and  the  more  abstract  design  is  indicated  py  Figure  25, 

9,  Semantic  Representation 

One  of  the  most  fundamental  tasks  In  the  construction 
of  any  artificial  intellloence  system  Is  the  selection  and 
Implementation  of  a  scheme  for  representing  knowledge,  within  the 
past  year,  our  research  In  semantics  nas  concentrated  on  the 
development  of  a  modeling  scheme  for  use  In  natural  language 
understanding  that  Is  capable  of  encoding  multiple  aspects  of 
knowledge  In  a  uniform,  precise,  and  easily  manlpulatable  form. 
Special  emphasis  has  been  given  to  the  uniformity  of  representation 
since,  depending  upon  the  point  of  view  of  a  processing  algorithm  or 
the  disposition  of  the  apprentice,  a  given  piece  of  data  may  be 
regarded  Internally  or  expressed  in  output  In  a  variety  of  ways. 

The  representation  scheme  that  has  been  developed  for 
use  In  the  CBC  Is  a  variation  of  the  semantic  network  schemes  used  by 
Simmons  (39),  Shapiro  140],  Rumelhart  and  Norman  (41 J,  and  other 
researchers.  For  natural  language  applications,  networks  have  proven 
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FIGURE  25  RELATIONSHIP  OF  ABSTRACT  DESIGN  TO  SOFTWARE  MODULES 


to  oe  very  serv.ceable  encoding  structures#  ottering  such  recognized 
advantages  as  a  convenient  bidirectional  linkage  between  semantically 
related  data  Items  and  an  Inherent  facility  tor  associating  deep 
conceptual  case  systems  with  event  types.  To  extend  the  encoding 
power  and  flexibility  ot  semantic  networks,  we  have  developed  an 
augmentation  that  allows  the  nodes  and  c^rcs  ot  networks  to  be 
partitioned  Into  units  called  spaces.  This  allows  knowledge  to  be 
bundled  into  units#  thereby  helping  to  condense  and  organize  the  deta 
base.  Specifically#  Partitioning  allows  quantification#  abstraction# 
and  categorization  to  be  handled  easily  by  networks.  Partitioning 
also  facilitates  the  encoding  of  process  Infornatlon  and  the 
translation  from  English  into  network  representations.  (A  discussion 
df  partitioned  semantic  networks  Is  contained  In  Kef,  42. 

a,  Basle  Network  Notions 

In  Its  simplest  form#  a  semantic  network  Is  a 

set  of  nodes  Interconnected  py  an  accompanying  set  ot  arcs.  A  node 

may  be  used  to  represent  an  object#  where  an  object  may  be  virtually 

anything#  including  physical  objects#  relationships,  sets#  events, 

rules#  and  utterances.  Arcs  are  used  to  represent  certain 

« 

"primitive"  omnlchronlc  (l.e.#  time  invariant)  relationships,  (Such 
relationships  may  also  be  represented  as  nodes.) 

A  feeling  for  how  nodes  and  arcs  are 
organized  to  represent  various  tacts  may  be  aainec,  by  considering  tne 
network  of  Figure  26,  In  this  network  the  node  'PHYSICAL, OBJECTS' 


(single  quotes  aie  used  to  delimit  nodes)  represents  the  set 
PHYSICAL. OBJECTS,  the  set  of  all  physical  oblects.  LDcewlse,  node 
'MACHINE, PAHTS'  represents  the  set  of  an  machine  parts.  The  arc 
labeled  "s”  from  'MACliliv'E. PARTS'  to  'PH YS ICAL .OBJECTS '  Indicates  that 
MACHINE. PARTS  Is  a  subset  of  PHYSICAL. OBJECTS.  Similarly,  the 
network  Indicates  that  BOLTS  is  a  subset  of  MACHl NE . PARTS  and  that  B, 
an  Element  of  BOLTS,  is  a  particular  bolt.  Followina  the  hierarchy  of 
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4notner  family,  X  Is  a  particular  box,  an  element  of  BOXES,  a  subset 
Of  CONTAINLhS,  a  subset  of  PhySlCAIi.CBJECTS. 

Node  'C'  encodes  a  containing  situation,  an 
element  of  the  situations  set  <slt-contain>,  a  subset  of  SITUATIONS, 
tne  set  of  all  situations.  In  particular,  'C'  represents  the 
containing  of  bolt  B  by  box  X  from  time  T1  until  time  T2,  The 
various  component  parts  of  situation  C  are  associated  with  it  through 
special  deep  case  relationships.  For  example,  in  the  network  there 
is  an  arc  labeled  "content"  from  'C'  to  'B*.  Tnls  arc  Indicates  that 
B  Is  the  ((^content  of  situation  C,  where  the  notation  "iMcontent  of 
C"  means  "the  value  (i)  of  the  content  attribute  (®)  of  C," 
Similarly,  X  Is  the  »Pconlalner  of  C  while  T1  and  12  are  the 
•  @start-tlme  and  #@pnd-tl[re  respectively. 

As  a  general  principle,  arcs  encode  only 
element,  subset,  and  case  relationships,  CUnder  one  Interpretation, 
element  and  subset  relations  may  be  viewed  as  deep  cases  also.)  Arcs 
are  never  allowed  to  encode  relationships,  such  as  ownership,  which 
are  time  bounded, 

b.  Net  Partitioning 

The  central  idea  of  net  partitioning  Is  to 
separate  the  various  nodes  and  arcs  of  a  network  Into  units  called 
spaces.  Every  node  and  every  arc  of  the  overall  network  Is  assigned 
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partitioning  is  enclosed  within  a  dotted  line.  Kor  pxample»  space 
Si  is  at  the  top  of  the  figure  and  Includes  nodes  'PHYSICAL, OBJECTS' , 
'BOLTS'f  '<sit-contain> ' »  and  'BOXES',  Si  also  Includes  the  two  s 
arcs  indicating  that  the  set  of  BOLTS  and  the  set  of  BOXES  are 
subsets  of  the  set  of  PHYSICAL , OBJECTS ,  In  our  dlagramatlc 
representations  of  semantic  nets,  an  arc  belongs  to  a  space  if,  and 
only  if,  the  arc's  label  is  written  within  the  dotted  line  boundaries 
of  the  space.  Thus  the  e  arc  from  'B'  to  'BOLTS'  lies  in  space  S2. 

The  various  spaces  of  a  partioning  are 
o^^ganized  into  a  partial  ordering  such  as  that  shown  in  Figure  28,  In 
viewing  the  semantic  network  from  some  point  S  in  this  ordering,  only 
those  nodes  and  arcs  are  visible  tnat  He  in  S  or  in  a  space  apove  S 
in  the  ordering.  Thus,  tor  example,  from  space  S2  of  Figures  27  and 
28,  oray  those  nodes  and  arcs  lying  in  S2  or  Si  are  visible,  in 


particular,  it  is  posslole  to  see  that  B  is  a  BOLT  and  that  BOLTS  are 
PHYSICAL, OBJECTS,  hut  it  is  not  Possible  to  See  tnat  X  is  a  BOX.  irom 
space  S5,  Information  in  spaces  S5,  S3,  S2,  and  si  is  visible.  Hence, 
from  S5,  the  whole  of  the  semantic  network  of  Figure  27  may  oe  seen. 
CFor  certain  applications,  the  net  may  oe  inspected  one  space  at  a 
time.  For  example,  it  is  possible  to  query  the  net  in  such  a  way  that 
only  nodes  and  arcs  lying  in  space  S2  are  visible  even  though 
information  in  Si  Is  normally  visible  whenever  S2  is  Inspected.) 

In  oractlce,  partitioned  networks  are 
constructed  by  creating  emoty  net  spaces,  adding  them  to  tne 
P.rtltlon  ordering,  and  then  creating  nodes  and  arcs  within  each 
newly  created  space.  The  use  of  partitioning  in  the  encoding  of 
quantified  statements  and  categories  is  the  sublect  of  the  next  two 
sections , 

c.  Quantified  Statements 

In  addition  to  an  ability  to  encode  specific 
facts  (such  as  the  containing  event  encoded  in  Figure  2b),  a  semantic 
system  needs  some  facility  for  grouping  sets  of  similar  facts  into 
units--so  as  to  allow  those  tacts  to  be  represented  collectively 
through  some  sharing  mechanism  and  to  be  conceptualized  as  an 
integrated  whole.  An  ability  to  encode  generalized  information  (in 
the  form  of  quantified  expressions)  is  of  considerable  importance 
since  it  is  often  impractical  (or  even  impossible)  to  record  the  same 


information  by  a  collection  of  individual  specific  statements,  poth 
because  of  the  very  number  (possibly  Infinite)  of  statements 
required,  and  because  details  of  particular  individuals  may  not  bc- 
explicitly  known.  Further,  since  quantification  is  a  component  of 
language,  an  ability  to  encode  quantifiers  is  vital  to  the 
understanding  of  certain  classes  of  English  sentences, 
(Quantlflerr  were  seldom  used  explicitly  in  the  dialogs  gathered  in 
our  protocol  experiments  con'”srnlng  mechanical  tasks. 
Nevertheless,  quantification  is  needed  for  the  representation  of 
world  knowledge.) 

As  an  example  of  how  quantification  is 
handled  in  partitioned  networks,  consider  the  network  of  Figure  29 
Which  encodes  the  statement 

"Every  bolt  in  the  box  is  3/4  inch  long 

and  has  a  nut  screwed  onto  it," 

In  this  network,  the  node  'GS'  represents  the  set  of  all  general 
statements  (the  set  of  statements  involving  universal  quantifiers  or, 
under  another  interpretation,  the  set  of  recurring  patterns  of 
events).  The  node  'g'  represents  the  particular  statement  (set  of 
events)  cited  above. 

Characteristically,  a  general  statement 
encodes  a  collection  of  separate  circumstances,  all  of  which  follow 
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FIGURE  29  EVERY  BOLT  IN  THE  BOX  IS  3/4-INCH  LONG  AND  HAS  A  NUT  SCREWED 
ONTO  IT 


the  Same  basic  pattern.  This  basic  pattern  is  represented  by  the 
#aform  of  the  general  statement.  The  KPtorm  of  g  is  encoded  by  a 
net  space,  S4,  which  lies  just  below  Si  in  the  partition  ordering. 
(When  one  net  space  is  pictured  inside  another,  the  inner  space  is 
below  the  outer  in  the  partition  ordering.)  This  net  space  may  be 
thought  Of  as  a  super-node,  containing  its  own  internal  structure  and 


representing  a  composite  variable  that  takes  on  a  different  value  for 


each  of  the  Instantiations  of  the  recurring  pattern.  Each  node  and 
arc  within  the  space  of  the  super-node  may  be  thought  of  as  a 
subvar lable. 


General  statements  are  also  typically 
associated  with  one  or  more  universally  quantified  variables*  which 
are  allowed  to  assume  values  in  some  specified  range.  Statjment  g* 
for  example,  has  a  universally  quantified  variable  b  given  by  Its  lavv 
attribute.  Note  that  variable  b  Is  necessarily  a  part  of  the  inform 
of  g  (l.e.,  'b*  lies  In  space  S4).  From  node  *d'  there  is  an  e  arc 
to  the  set  the  .bolts . In . the .box ,  Indicating  that  the  value  of  b 
(written  Ob)  must  be  taken  from  the  range  set  the .bolts  . In .the .box . 
(The  node  ' the .bol ts . In .the .box '  has  been  created  especially  to  help 
encode  the  general  statement.  Its  meaning  may  be  Inferred 
subsequently  when  the.ool ts .in  .box.X  is  defined  In  paragraph  "d" 
below . 


The  Interpretation  of  a  general  statement  Is 
that  for  each  assignment  of  the  variables  OfiVv  to  values  In  their 
corresponding  ranges,  there  exist  entitles  matching  the  structure  of 
the  #@form.  For  g  this  means  that  for  every  lb  an  element  of 
the, bolts. In. the. box  tiiere  exist 

Ih  C  <has.length> 

Is  C  <slt-screwed;slmpllstlc> 


In  C  NUrs 


and  the  relations 


#b  Is  the  of  dh 

3/41NCH  Is  the  measure  of  Ih 
»b  Is  the  d^itrt  of  ds  (i.e.,  do  is  the  male 
-threaded  part  of  ds) 
and  dn  is  the  d^ft  of  ds. 

Thus,  the  interpretation  of  q  is  that  for  every  #o  m 
the. bolts. In. the. box.  there  exists  a  situation  dh  In  which  the  lenoth 
Of  UBJect  ib  is  the  MEASURE  3/4  inch.  Since  '3/41NCH'  nes  outside 
space  S4.  there  Is  only  one  measure  for  all  the  holts  in  the  box. 
Further,  tor  each  holt  db  there  is  a  nut  dn  (depending  on  the 
Individual  #b)  that  is  In  a  situation  of  being  screwed  onto  #b.  (A 
screwedtslmpilstlc  connection  tray  exist  only  oetween  two  threaded 
Objects.  one  with  male  threads  (the  i^mt)  the  other  with  female 
threads  (the  #@£t).  A  screwed; simplistic  connection  may  be  contrasted 
with  screwed:standard  connections  In  which  multiple  unthreaded  parts 
are  held  together  by  a  bolt  (or  other  threaded  object)  that  passes 
through  the  unVhreaded  objects  to  engage  a  nut.) 

Complex  guantiflcatlons  entailing  nested 
scopes  may  also  be  encoded  by  net  spaces,  as  shown  abstractly  In 
Figure  30. 
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FIGURE  30  A  COMPLEX  ABSTRACT  QUANTIFICATION 
(VaeA)(3beB)(Vc€C)(ddec)[P(a,b,d)] 


d.  Rules  and  Categories 

A  convenient  method  for  organizing 
In  a  semantic  system  Is  to  divide  the  various  oojects 
physical  objects*  situations*  and  event  objects)  In  the 
aln  Into  a  number  of  categories.  Using  categories. 


objects  that  are  somewhat  allxe  become  grouped  together*  allowing 


similar  objects  to  be  thought  acout  and  talked  about  collectively. 
The  scheme  Is  hierarchical  In  that  some  categories  may  be 
subcategories  of  more  general  classes.  The  lower  a  class  Is  In  the 
category  hierarchy,  the  more  alike  Its  members  must  be.  The 
'likeness"  arises  In  that  members  of  each  category  possess  certain 
common  characterizing  properties  (such  as  deep  conceptual  cases  or  an 
association  with  a  common  attribute. 

The  categorical  system  serves  the  Important 
purposes  of  spotlighting  similarities  among  oojects  and  compressing 
redundant  Information  by  recording  common  Information  at  the  category 
level  rather  than  with  the  individual.  if  an  object  Z  Is  known  to 
belong  to  some  category  K,  then  Z  Is  known  to  possess  the  common 
properties  of  K's  members  and  the  common  properties  of  the  members  of 
each  Of  K's  supercategories.  This  ability  to  ehcode  Information  at 
the  category  level  rather  than  with  each  Inolvldual  Is  of  practical 
Importance  because  It  saves  computer  memory  and  because  all  the 
elements  of  a  category  (perhaps  being  Infinite  in  number)  may  not  be 
explicitly  known. 

For  natural  language  processing,  the  category 
system  has  the  Important  feature  that  members  of  the  more  significant 
categories  (the  categories  commonly  held  in  the  minds  of  humans)  are 
expressed  by  the  same  set  of  linguistic  Patterns.  As  an  elementary 
example,  screwdrivers,  wrenches,  hammers,  an  i  saws  belong  to  a 
category  of  objects  that  may’  be  expressed  by  noun  phrases  headed  by 


the  noun  "tool."  Various  attaching  events  Kay  be  expressed  by 
complete  sentences  using  the  words  "attach."  "mount."  or  "fasten"  as 
their  central  verbs. 

Central  to  the  notion  of  a  category  Is  the 
notion  of  a  rule  that  specifies  a  necessary  and  sufficient  test  for 
category  membership.  Necessary  rules,  which  all  cateaory  members 
must  obey,  and  sufficient  rules,  which  can  prove  that  an  object 
belongs  to  a  given  category,  are  also  of  importance. 

As  a  simple  example  of  a  category  and  Its 
defining  rule,  consider  the  category  of  bolts  In  box  X.  This 
category  is  represented  by  the  node  'tne. bolts. in. box. X'  of  Figure 
31.  with  the  associated  rule  being  encoded  by  net  space  S2.  The 
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FIGURE  31  THE  NECESSARY  AND  SUFFICIENT  RULE  DEFINING  "THE  BOLTS 
IN  BOX  X" 


ens  '  arc  ^ying  in  space  S2  from  node  'b'  to  'the  .bolts . in .oox .X' 
Indicates  that  'b'  represents  what  may  oe  thought  of  as  an  arcfietypal 
element  of  the  category.  CSyrr.bol  "ens"  means  archltypal  element, 
necessary  and  sufficient.)  Any  object  with  the  characteristics  ct  b 
belongs  to  tne  category,  and  all  mempers  of  the  category  have  the 
characteristics  of  b.  As  encoded  In  space  S2,  the  charac^’erlstlcs 
of  b  Include  membership  in  bULlS  (the  set  ot  all  bolts)  and 
Involvement  as  the  ^content  in  a  containing  situation  in  which  box  X 
is  the  »i>icontainer . 

In  natural  language  processing,  particularly 
during  the  oarslm  phase  when  surface  structures  are  being  translated 
into  nets  and  when  the  semantic  well  formed ness  of  sentences  and 
sentence  tragmerts  is  being  tested.  It  is  Important  to  Know  what 
attriDUtes  (oeep  cases)  are  associated  with  certain  categories  of 
objects  (especially  wltn  event,  situation,  and  other  verD-ll<e 
categories)  and  wha*  ranoe  ot  values  each  attribute  may  assume.  This 
Information  has  utility  because  attributes  indicate  the  types  of 
participants  that  are  involved  in  particular  categories  ot  situations 
ant)  because  there  Is  often  a  direct  mapping  from  syntactic  cases 
(including  prepositional  phrases)  to  these  attributes.  Knowing  tne 
correspondences  between  surface  cases  and  attributes  and  knoving  the 
ranges  of  values  tor  each  attribute  allow  some  uarsefi  to  be  rejected 
on  macr osemant Ic  grounds  and  provide  a  facility  ';or  predicting  the 
citing  of  certain  situation  participants  in  the  surface  language. 
(This  prediction  ability  is  especially  Important  tor  speech 
understanding . ) 


'Oe  attribute-range  Information  tor  a 
category,  collectively  referred  to  as  tne  category's  delineation,  may 
be  associated  with  the  category  through  a  delineation  rule,  A 
delineation  rule  is  a  necessary  rule  that  Includes  ranoe  Intornatlon 
about  every  attribute  of  the  delineated  category. 

As  an  example  of  a  delineation  rule,  consider 
the  delineation  of  category  <to-bolt>,  the  category  of  events  in 
Which  two  machine  Parts  are  attached  oY  using  bolts  as  fasteners. 
Delineation  Information  for  this  category  is  encoded  by  the  network 
of  Figure  32,  In  this  network,  tne  node  '<to-bolt>'  Is  linked  to  a 
node  'b'  by  an  ed  arc  which  indicates  that  b  is  the  delineating 
"element"  of  <to-bolt>.  Encoded  within  space  S4  is  attribute-range 
information  concerning  each  of  the  six  attributes  possessed  oy 
members  of  <co-bolt>,  in  particular,  the  rule  encoded  by  space  S4 
Indicates  ttat  a  bolting  event  Involves  an  »f*actor  taken  from  tne  set 
of  lNTtLiLIGENT,AMMATt,U8JtCTS,  a  «ainlnor-p  and  a  #@ma3or-p  taken 
from  the  set  of  MACHINE , PARTS,  a  set  of  fasteners  taken  from  tne 
Set  of  BOLT/NUTS  ra  bolt/nut  is  a  bolt  and  a  nut  which  work  together 
to  form  a  single  fastener),  a  »Ptool  taken  from  the  set  of  TociLS 
(Which  Includes  hands  and  fingers),  and  a  #(f»tlme  taxen  from  the  set 
of  TIME, INTERVALS. 


Given  the  two  sentences 

"I  bolted  the  pump  to  the  base  plate  wiTH  1 
INCH  BULTS," 
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"ens"  arc  lying  in  space  S2  from  node  'b'  to  ' t ne . bo  1 1 s . 1 n . oox  ,  X ' 
indicates  that  'b'  represents  what  may  oe  thouqnt  of  as  an  archetypal 
element  of  the  cateuory.  (Symbol  "ens"  means  architypal  elemert, 
necessary  anci  sufficient.)  Any  object  with  the  characteristics  of  b 
belongs  to  the  category#  and  all  memoers  of  the  category  have  the 
characteristics  of  b.  As  encoded  in  space  S2»  the  characteristics 
of  b  Include  membership  in  bULlS  (the  set  of  ail  bolts)  and 
involvement  as  the  Oidcontent  In  a  containing  situation  in  which  box  X 
is  the  i»(Ficontainer . 


in  natural  language  processing,  particularly 
during  the  parsing  phase  when  surface  structures  are  being  translated 
into  nets;  and  when  the  semantic  well  formedness  of  sentences  and 
sentence  tragmerts  is  being  tested#  it  is  important  to  know  what 
attriputes  (deep  cases)  are  associated  with  certain  categories  of 
objects  (especially  with  event,  situation,  and  other  verb-like 
categories)  and  what  ranoe  of  values  each  attribute  may  assume.  This 
information  has  utility  because  attributes  indicate  the  types  of 
participants  that  are  involved  in  particular  categories  of  situations 
and  because  ttiere  is  often  a  direct  mapping  from  syntactic  cases 
(including  prepositional  phrases)  to  these  attributes.  Knowing  tne 
correspondences  between  surface  cases  and  attributes  and  knowing  the 
ranges  of  values  for  each  attribute  allow  some  parses  to  be  rejected 
on  macrosemant ic  grounds  and  provinc  a  facility  for  predicting  tne 
citing  of  certain  situation  participants  in  the  surface  language, 
(This  prediction  ability  Is  especially  Important  tor  speech 
understanding , ) 


slnqle  rule  linked  directly  to  the  category 


In  prdctice» 


categorical  information  is  almost  always  distributed  among  many 
points  in  tne  categorical  hierarcny.  To  see  how  information  is 
distributed  at  various  levels#  consider  the  hierarchy  of  <to-attach> 
events  that  are  shown  in  Figure  33.  The  most  general  category  in  the 
hierarchy  is  category  U,  the  universal  set,  tven  U  has  a 
delineation#  since  all  objects  (Including  events  and  situations) 
exist  over  some  (po*^sibiy  one-point  or  infinite)  time  interval.  h 
subset  of  U  is  <to-attach>#  the  set  of  all  attaching  events  of  any 
nature  whatever,  Members  of  <to-attach>  inherit  the  time  attribute 
from  supercategory  U  and  add  two  additional  attributes#  imparts  and 
#f*actor»  of  their  own.  In  general#  each  attaching  event  involves  a 
set  of  imparts  that  an  i@actor  binds  together  in  some  way. 

Two  subcategories  of  <to-attach>  are  shown  in 
Figure  33,  The  first  is  <to-screw:slmpllstlc>#  which  is  the  set  of 
events  in  which  two  threaded  objects#  one  (#@mt)  with  male  threads# 
the  other  (i@ft)  with  female  threads#  are  engaged  by  twisting.  Notice 
that  the  delineation  rule  of  this  category  shows  that  the  »f^mt  and 
the  #@ft  are  both  elemehts  of  the  «6*Darts,  The  cardinality  of 
Imparts  is  at  most  two  (but  could  be  one#  as  for  a  garden  hose  with 
one  end  attached  to  the  other), 

A  second  subcategory  of  <to-attach>  is 
<to-attach;fastener>#  the  category  of  fastening  events  in  which  the 
Imparts  are  attached  with  fasteners,  (Screwing  a  light  bulb  into  a 
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FIGURE  33  THE  <rO-ATTACH>  FAMILY 
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socket  requires  no  fasteners  and  is  a  simplistic  screwlnq  event. 
Nailing  a  sign  to  a  post  requires  a  nail  as  a  fastener.)  The 
delineation  of  <to-attacn: fastener>  simply  adds  the  attribute  of 
laf  asten‘Ts , 

Category  <to-bolt>  Is  a  subcategory  of 
<to-attachi tool>  which  is  a  subcategory  of  <to-attach ;  f astener> .  The 
delineation  of  <to>-'bolt>  shown  in  Figure  33  Indicates  how  the 
i@major-p  and  the  iPmlnor-p  are  related  to  »i?parts  and  to  each  other. 
Further,  the  i^ifasteners  used  by  bolting  events  are  restricted  to  be 
bolt/nuts  as  opposed  to  any  type  of  fastener.  Linkage  to  a  process 
automaton  that  indicates  the  sequence  of  changes  characterizing  a 
bolting  event  might  also  be  Included  with  the  category  Information 
but  has  been  omitted  here  tor  simplicity. 

e.  Abstraction 

Since  a  user  may  thlrnc  at  varying  levels  of 
detail,  it  15  important  for  the  semantic  system  to  be  able  to  encode 
information  at  multiple  levels  of  abstraction  and  have  some 
capability  for  jumping  from  one  level  to  another.  Figure  34  shows 
one  Way  in  which  net  Partitioning  may  be  used  to  encode  an  attaching 
event  A  at  two  levels  of  detail.  By  viewing  the  network  from  the 
vantage  of  space  S2  (which  lies  below  Si  in  the  ordering  and  is  a 
sister  space  to  S3),  A  is  seen  to  be  an  element  of  <to-attacn>,  since 
the  e  arc  lying  in  S2  is  visible.  Since  the  information  lying  in 
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FIGURE  34  VIEWING  A  BOLTING  AT  TWO  LEVELS  OF  DETAIL 


S3  is  Invisible  trom  S2,  A  appears  to  have  only  an  #@actor  and  a  set 
of  imparts  and  Is  not  seen  to  Involve  i@fasteners.  From  S3  the  same 
event  nay  be  viewed  with  more  detail,  Mrst,  the  e  arc  from  A  to 
<to-attach>  Is  Invisible  and  A  Is  thus  seen,  as  an  element  of 
<to-bolt>,  a  subset  of  <to-attach>.  Further,  at  this  finer  level  of 
detail,  the  iPfasteners  Involved  In  the  attaching  (bolting)  event  are 
visible  (as  are  tools  and  the  like,  wnlch  are  omitted  from  the  figure 
for  simplicity). 
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A  very  Important  aspect  of  the  worKstation 
domain  Is  that  of  chanqe.  Since  sequences  of  chanqe  tend  to  to.,  low 
certain  reqular  patternsi  It  Is  convenient  to  organize  the  recurring 
Sequences  of  change  Into  categories^  grouping  similar  sequences 


together , 


Each  category  of  sequential  chanqe  Is  tantamount  to  an 


event  category#  the  memoers  of  whlcn  may  oe  thought  of  as  Individual 
enactments  of  a  common  plot  or  script  which  encodes  a  generalized 


pattern  of  change. 


For  example,  every  event  of  tightening  bolts 


follows  the  plot  consisting  of  finding  a  Arrench#  putting  the  wrench 
on  the  bolt,  twisting  the  bolt  clocicwise,  ^nd  so  on.  Each  enactment 
casts  different  actors  in  the  various  roles,  out  follows  the  same 


basic  pattern. 


Since  the  members  of  a  particular  event 
category  may  be  distinguished  as  exactly  those  Instantiations  of 
sequential  change  that  follow  some  particular  script,  the  script 
Itself  forms  the  basis  for  a  rule  defining  the  event  category. 


During  the  past  year  we  have  been  considering 
ways  to  encode  process  scripts  In  semantic  networtcs  for  use  In 
language  processing.  The  procedural  nets  developed  by  the  CuC 
Planning  group  are,  of  course,  a  representation  of  process  Knowledge, 
and  we  anticipate  the  eventual  merger  of  procedural  and  semantic 
networks-  However#  since  procedural  nets  were  not  designed  with 


.  •  1.  -  u,  -  . 
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language  processing  In  mlnd»  we  have  considered  Process  automata  1.42] 
as  a  possible  alternative,  A  process  auto.-naton  Is  a  section  of 
semantic  network  that  resembles  a  MealY  niachlne  or  a  Woods  AFSiri 
system  [43],  While  AFi>ln  was  oeveloped  as  a  programming  structure 
to  describe  the  process  of  parsing  language,  the  process  automaton 
has  been  developed  as  a  data  structure  for  descrlolno  the  processes 
(prototypal  plots)  cited  by  lanauage  and  may  be  regarded  as  a  parsing 
grammar  that  Interprets  (or  generates)  a  sequence  of  changing 
conditions  rather  than  a  sequence  of  words.  If  a  path  can  be  found 
through  a  process  automaton  network  for  a  given  sequence  of  changes, 
then  the  sequence  is  accepted  as  a  "word"  (an  enactment)  In  the 

-language"  (category  of  events)  defined  bv  the  "grammar"  (process 
automaton ) , 

During  the  next  year,  further  study  win  he 
given  to  the  problems  of  encoding  scripts  m  networks?  a  common 

ground  for  procedural  networks  and  process  automata  Is  expected  to  be 
found , 

"J*  Translating  Into  Semantic  Networks 

Although  no  attempt  has  yet  been  made  to 
process  natural  language  In  the  CBC  domain,  the  semantic  translation 
routines  written  for  the  SHI  speech  project  were  developed  with  the 
requirements  of  the  CbC  domain  In  mind,  since  the  techniques  for 
building  network  representations  of  Input  sentences  are  discussed  In 


Ref.  3b  the  description  will  not  be  repeated  here,  with  the  recent 
modification  of  the  speech  parser,  whlcn  allows  it  to  accept  text 
Input,  semantic  routines  tor  translatino  CRC  related  data  are 
expected  to  be  available  within  the  next  six  months. 


10,  Re  latino  the  Semantic  Structure  to  Discourse  Needs 

In  the  section  on  dialog  analyses  we  mentioned  two 
problems,  reference  and  object  description,  which  were  closely 
related  and  which  may  now  be  discussed  further.  As  mentioned  earlier, 
solutions  to  both  of  these  problems  depend  on  belnq  able  to  supply 
contextual  focus,  that  Is,  an  ability  to  restrict  the  system's 
attention  to  a  small  but  pertinent  subset  of  Its  total  Icnowiedqe. 
Since  the  system's  knowledge  Is  recorded  in  a  semantic  network,  a 
form  of  net  partitioning  may  be  used  to  group  together  those  facts 
that  are  likely  to  be  pertinent  at  a  given  Point  In  the  dialog.  For 
task-oriented  dialogs,  the  division  of  tne  dialog  Into  coneslve 
subdlalogs  is  closely  tied  to  the  task  structure,  inis  structure  Is 
embodied  In  the  procedural  net,  which  encodes  tne  task  structure  in  a 
hierarchy  of  subtasks.  Grouping  the  information  relevant  to  each 
subtask  Into  a  separate  net  space,  and  ordering  the  net  spaces  in 
accordance  with  the  procedural  net  hierarchy,  produce  a  knowledge 
structure  that  supplies  contextual  focus. 

Figure  35  Is  the  semanulc  net  representation  of  a 
wrench  w  and  Its  relationships  to  other  objects  (by  "objects"  we  mean 
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WRENCHES 


FIGURE  35  SEMANTIC  NET  FOR  WRENCH,  W.  WITH  LOGIC  PARTITIONING 


any  entity  that  is  encoded  as  a  node  in  the  scnantlc  net).  Note  that 
this  is  only  a  fragment  of  a  semantic  netj  only  a  subset  of  the 
relationships  in  which  ^  might  participate  are  shown.  The 
partitioning  shown  is  the  logical  partitioning  described  in  Section  0 
above.  Space  Sw  of  this  partitioning  is  used  to  delineate  the  class 
of  wrenches,  and  Indicates  that  each  wrench  has  a  #fisize  and  an 
l^endtype,  (These  components  of  a  wrench's  description  are  indicated 
through  case  relationships  because  they  are  time  invariant,  intrinsic 
properties.  Neither  the  size  nor  the  enatype  of  a  wrench  may  ce 
altered  without  destroying  the  wrench  itself.  Node  structures  could 
have  been  used  to  encode  this  information,  but  such  an  encoding  is 
more  expensive  and  is  not  needed  here.)  wrench  w,  an  element  of 
WRENCHES,  has  #(asize  1/2-inch  and  »(dendtype  BOX-END,  In  addition  to 
the  intrinsic  properties  of  size  and  endtype,  wrench  w  has  the 
distinction  of  having  been  used  (as  the  in  the  attaching  of 
the  pump  to  the  platform  between  times  Ti  and  rj  and  of  being  in 
(being  the  #@content  of)  the  apprentice's  left  hand  from  time  T)f  to 
the  present,  (note:  "Time"  arcs  go  to  intervals.  An  entity  may  also 
have  a  #@start-tlme  and  a  iRend-time;  in  this  case  the  interval  is 
[#9endtime,#?starttlmc)). 

All  of  this  information  is  part  of  the  history  of 
wrench  W,  As  such,  any  of  it  may  oe  used  in  the  description  of  w. 
However/  in  any  giver  contextual  focus  only  some  of  it  is  valuable. 
For  this  reason  we  would  like  to  be  able  to  highlight  certain  arcs 
and  nodes  in  the  network  while  they  are  in  focus,  letting  them  return 
to  their  unhlqhl Ighted  state  when  the  focus  changes. 


In  order  to  do  tnls,  network  partitioning  is  used  in 
a  new  way.  Nodes  and  arcs  belong  to  botn  loalcal  and  focus  spaces. 
The  logical  and  focus  partitions  are  orthogonal  to  one  another  in  the 
sense  that  the  logical  space  upon  which  a  node  or  arc  lies  neither 
determines  nor  depends  on  tne  focus  space  In  which  the  node  or  arc 

lies.  (The  focus  partitioning  differs  from  the  logical  one  In  several 
ways  wnich  we  wm  discuss  shortly). 


The  procedural  net  representation  of  a  task  encodes 
Poth  the  subtask  hierarchy  and  the  partial  ordering  of  subtask 
performance  for  that  task.  For  any  given  execution  of  the  task,  only 
a  subset  Of  the  nodes  in  the  Procedural  net  are  invoked.  These 
correspond  to  the  suotasks  actually  discussed  by  the  apprentice  and 
the  expert.  For  example,  it  the  expert  directs  the  apprentice  to 
attach  the  belt  housing  cover  and  the  apprentice  replies  by  saying 
that  he  has  done  that,  then  the  nodes  that  correspond  to  details  of 
how  to  perform  the  attaching  are  never  Invoked. 

ior  each  subtask  entering  the  dialog  a  new  focus 
space  Is  created.  The  procedural  net  Imposes  a  hierarchical  ordering 
on  tnese  -spaces.  This  hierarchy  win  be  used,  as  the  logical  one  is, 
to  determine  what  nodes  and  arcs  are  visible  from  a  given  space.  Note 
In  particular  that  tne  arcs  and  nodes  that  belong  -to  a  space  are  the 
only  ones  Immediately  visible  from  that  space.  Arcs  and  nodes  in 

spaces  that  are  above  a  given  space  are  also  vlslole,  but  must  be 
requested  specially.  Other  arcs  and  nodes 


are  not  visible. 


As  mentioned  previously,  tne  focus  partltlonlnu 
differs  from  the  loqlcai  partltioninq  In  several  ways,  hirst,  a  node 
may  appear  In  any  numner  of  focus  spaces  (but  must  appear  in  exactly 
one  loqical  space).  This  happens  when  the  same  object  I*'  used  In  two 
different  subtasks  fe.q.»  the  wrench  of  h Iqure  S).  hither  the  same 
or  different  aspects  of  the  object  may  be  in  focus  in  tne  two 
subtijsks.  It  is  also  possible  for  a  node  or  arc  to  be  in  no  focus 
space.  This  just  means  that  the  object  is  not  stronqiy  associated 
with  the  performance  of  any  particular  subtask.  For  completeness,  we 
define  a  top-most  space,  called  the  “communal  space,"  and  a 
Dottom-most  space,  called  the  "vluta  space".  The  communal  space 
contains  those  relationships  that  are  time-invariant  (e.q.,  the  tact 
that  tools  are  typically  found  in  toolboxes)  or  common  to  all 
contexts.  The  vista  space  is  below  all  other  spaces  and  hence  can  see 
everything  in  the  semantic  net.  This  is  useful  for  determining  all  of 
the  relationships  into  which  an  object  has  entered. 

Figure  36  snows  the  net  of  Figure  35  with  a  focus 
partitioning  superimposed  on  the  loqical  oartlonlno.  Focus  FI  views 
wrench  W  as  a  box-end  thath  which  is  being  used  in  the  operation  of 
bolting  the  pump  to  the  platform.  Focus  Fj  views  the  same  wrench  as 
one  that  is  in  the  apprentice's  left  hand.  The  otner  information 
about  the  wrench  (e.q.,  its  size)  is  recorded  in  the  communal  space. 
All  of  the  information  is  visible  from  the  vista  space. 


The  representation  of  an  objer'.  in  a  focus  space  will 
Include  only  the  relationships  that  have  been  mentioned  in  the  dialoq 


concerning  the  cor respondinq  subtasic  or  that  are  inherent  in  tne 
procedural  net  description  of  the  local  tas<.  The  distinction 
between  the  verbal  context  and  tne  general  world  knowledge  context 
that  we  mentioned  in  Section  4  above  (Dialog  Analyses)  may  now  be 
seen.  The  verbal  context  is  supplied  by  the  information  recorded  in 
the  subspace  hierarchy,  Tne  general  world  knowledge  context  is 
information  that  is  present  in  the  communal  soace.  '^hen  resolving  a 
reference#  we  can  decide  how  to  divide  effort  between  examining  links 
in  the  local  space  and  looking  back  into  the  communal  space. 


An  advantage  of  adding  this  new  partitioning  is  that 
special  Information  can  be  recorded  at  the  local  focus  level.  Thus  if 


several  links  in  the  net  must  oe  followed  to  establish  some  fact 
about  an  object  (i,e.»  some  logical  deduction  must  be  done)#  the 
result  of  that  work  may  oe  stored  explicitly  in  the  local  focus 


space.  The  logical  deduction  does  not  have  to  oe  redone  for  local 
references.  If  this  information  is  put  in  its  own  logic  space#  then 
it  remains  invisible  from  the  knowledge  net  (the  topmost  logic 


space).  For  example#  consider  the  situation  portrayed  in  Figure  37. 
All  of  the  nodes  and  arcs  in  this  figure  are  in  one  focus  space#  FI, 
B-E  is  a  set  of  box-end  wrenches  to  which  wi  belongs.  H-E  is  a  set  of 


hex-end  wrenches  to  which  W2  belongs.  If  the  apprentice  now  says# 
” , , ,  the  box-end  wrench"#  he  means  wi.  The  utterance  level  structure 
(created  by  parsing)  for  the  phrase  "the  box-end  wrench"  is  shown  in 


Figure  38#  and  some  amount  of  work  must  be  done  to  establish  tne 
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FIGURE  37  SEMANTIC  NET  SHOWING  MEMBERS  OF  TWO  SUBSETS  OF  THE 
SET  "WRENCHES" 
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FIGURE  38  SEMANTIC  NET  FROM  PARSE  FOR  "BOX-END  WRENCH" 
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Frp^dom  of  '^ovpi^ent 

Onp  way  to  inrrpasp  the  cover  of  our  modPls  of 
mechanical  equin’nent  Is  to  Include  in  tKP  -.odels  a  reoresentat  ion  of 
the  freedotP  of  moverrent  exls:lm  between  comnonents  of  a  dpvlcp. 
Knowierjae  about  freedo-r  of  novprrent  enaUps  th**  system  to  answer  thp 
followino  kinds  of  ou pries! 

-  What  linear  freedom  of  movement  exists  between  two 

specified  components  in  a  soecifled  conf iourat ion 
of  the  device?  "Thev  are  riaidiy  attached", 

"Parti  can  move  oniv  in  the  ♦Y  direction  with  resnect 
to  Part?",  "Parti  and  Part?  do  not  Dhvsicaliy 
constrain  each  other",  and  so  forth.) 

-  If  Parti  is  pushed  in  direction  ♦X,  which  other 
components  win  move  alom  with  Parti,  and  which 
will  remain  stationary? 

-  How  is  Parti  supported? 


and,  by  extension. 


-  I  f  SDPclfled  opef'^tlon  is  performed  on  the  device 
(e.q.r  "Unscrew  bolt  ('"»  "Slide  the  crankshaft  in 
direction  -X",  "Tarn  the  crankcase  ops  I de-down " i 
will  any  rar*.s  lose  their  suonort*  and  hence  fall 
nut  of  Place? 

The  last  two  queries  require  the  aollitv  to  compute  povsical  (as 

oonoseci  to  loolcall  suoport.  Althouqh  there  are  other#  -^nre 
sophisticated  ways  to  conoute  support#  the  "freedom  of  movement" 
aDoroach  to  he  desctjped  below  oft«n  provides  correct  answ'ers  with 
relatively  little  comrutatioral  cost, 

Knowledoe  about  freedom  of  movement  is  belno 

incorporated  into  our  models  at  a  low  level.  Besides  facllltatlnq 
the  computation  of  physical  support#  this  knov’t^dae  can  be  used  In 
the  simulation  of  assembly-disassembly  actions  and  in  the  automatic 
qeneratlon  of  disassembly  subooals.  In  the  remainder  of  this  section 
we  will  discuss  our  representation  and  use  of  freedom  of  movement  in 
more  detail, 

a.  Represent Inq 

Recall  that  a  CO^nFCTIGn  Is  defined  for  each 
pair  of  components  that  are  In  contact  in  the  canonical  model  of  the 

fully  assembled  device,  We  characterize  the  freedom  of  movement 

(henceforth  abbreviated  "FM"j  restrictions  that  tne  tw©  components  of 


the  connection  lipnose  on  each  other 


When  they  are  POSlTlONRn 


or 


ATTACHFD  to  one  another,  and  associate  this  Information  with  the 
CONNECTION,  The  FM  restrictions  Irroos^'d  ny  a  connection  could  he 
represented  In  several  different  ways;  for  examoie: 

"  As  a  list  of  restricted  dUectlons  and/or 
rotations 

-  As  a  set  of  linear  constraints  relatlno  the 
positions  of  the  two  oarts 

-  t)<»duced  dlrectlv  from  a  oeometrlc  r eor esentat  1  on 
of  the  shapes  and  positions  of  the  parts 

(say,  by  dlsplaclna  one  part  and  seelnq  If  it 
intersects  the  other). 

Other  representations  are  Possible,  Includlna  hybrids  of  two  or  more 
of  these. 


We  have  Implemented  an  Fv  model  of  the  air 
compressor  pump,  uslnn  a  simplified  version  of  the  first  of  the  above 
representations,  in  wpich  only  translational  restrictions  and  not 
rotations  are  taken  Into  account.  The  current  version  of  this  model 
makes  the  simpiifyjnq  assumption  that  only  six  directions  exist, 
correspondinq  to  a  standard  set  of  three-dimensional  axes  and  denoted 
+  x,  -X,  aY,  -Y,  +7,  and  -Z,  In  this  model,  CHNNECTIClNs  are 


classitleri  Inco  Tvdps.  -‘■lere  th*  tvpe  charact er t zes  the  shape  of  the 
contact  bo'Jndary  between  the  tw©  parts.  The  cnMMFCTION  types 
represented  are; 

ABUTS  --  ItTpiies  a  flat,  surface  contact,  Kach 
part  restricts  the  of  the  other  Ir  one 
direction. 

SPiiviPhFS  --  a  Shaft  of  one  part  ooes  thro’-iah  a 
hole  in  the  other,  FM  is  restricted  in  everv 
direction  except  alona  the  axis  of  the  shaft. 

^^ESHF-S  --  one  part  Is  slid  or  seated  into  an 
Indentation  in  the  other.  FM  is  restricted  in 
all  but  one  direction. 

SCPF.WS-TN  --  One  Part  screws  into  the  other. 

FM  restrictions  depend  on  the  state  of  the  screw 
CONMECTTON  (tioht,  loose,  lust  positioned,  or 
reiToved) . 

This  Information  Is  stored  with  the  CONNECTION  as  the  value  of  the 
QLISP  property  "TYPE."  These  types  were  chosen  for  their  intuitive 
appeal,  based  on  icirds  of  connections  that  actually  occur  in  the 
pump.  Of  course,  ivny  number  of  andltlonal  types  can  be  defined,  but 
we  would  like  to  qet  by  with  as  few  as  possible  in  order  to  keen  the 
model  simple  and  aeneral.  we  have  found  the  above  four  types,  used 


slnqly  or  In  combination,  sufficient  to  represent  the  connections 
occurrina  in  the  Dump--a  reasonabiv  comniicateri  Piece  of  eqwlnment, 
as  indicated  In  Fiqure  40. 

with  each  cnMNP:CTTOM  is  stored  information 
pertaininq  to  the  orientation  of  the  contactlno  surfaces.  For 
example,  suopose  three  ahuttlnq  Parts  4,  H,  and  r  are  lined  up  alono 

the  X  axis  as  in  Floure  41.  We  have  two  rONNFCTinMs  of  type  aruts _ 

(A,B)  and  (B,C).  The  directional  Information  Is  stored  svmmetr lea i iv 
so  that  If  we  are  Interested  in  movlnq  oart  a,  we  discover  that  It  is 
restricted  by  part  B  in  direction  ♦X:  whereas  If  we  want  to  move  oart 
B,  we  find  that  it  is  restricted  by  part  A  m  direction  -X  (similarly 
for  the  CONNECTiom  between  h  and  r.  This  Information  Is  stored 
redundantly  on  the  COMhECTinu's  property  ust  under  the  Indicator 
DIHFCTIOhS;  for  example,  (...  DIRFfllONS  (A  +x  p  -XI  ...).  as  lono 
as  movement  is  restricted  to  translations,  FN-  restrictions  are 
transitive  and  can  be  viewed  as  rrooaqatlm  throunh  any  rlnld  part, 
^Jow  suppose  that  we  push  oart  A  in  direction  fX.  Ue  find  that  Part  R 
restricts  part  a's  FM  In  direction  eX;  likewise,  nart  C  restricts 
Part  B  s  FM,  also  In  direction  +X,  Ip  effect,  the  restriction 
"propaaates"  from  part  C  throuoh  Part  b  to  nart  A,  so  that  part  C 
also  restricts  part  A  in  +x. 

'Jf  course,  this  simple  an  approach  to 
representinq  movement  restrictions  win  not  always  work  perfectly. 
For  example,  suppose  parts  a,  H,  and  r  are  arranged  as  In  Floure  4?. 
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NAME  or  PART 


Rafaranca 

NuBbar 


NAME  or  part 


964  73  Head  Bolt 

3 

30 

31614 

Broothor  Valva  Spacar 

1 

4S007  Cylindar  Hoad  Covar 

1 

31 

3  6941 

Braothor  Volvo  Plato 

1 

45030  nitar  Scroan 

1 

33 

36944 

Braothar  Valva 

1 

4S03I  Pillar 

t 

33 

49003 

End  Covar  AaaaBbljr>lncludaa  Rof.  No  37 

1 

45034  Oullal  Valvo  Itop 

1 

34** 

49039 

Pulloy  for  lOl  TV 

1 

45014  Coppar  Woohar 

3 

39 

96637 

Pulley  Sat  9craw-*/{«' 1 6  a  Soekal  Haad 

4501  1  Oullot  VaWa  Sprlnf 

1 

36 

16060 

End  Cover  Bolt'V4>30  a  VS” 

a 

4S0IJ  Valvo 

3 

37 

9533 

Leckwaahar.  yf 

3 

45016  Outlot  Valva  Saat 

1 

36 

11109 

Has  Haad  Belta-%>30  s  1  ” 

3 

45019  Oullal  Valva  Ratalnar 

1 

39 

9933 

Lockwaahara'VS” 

6 

45017  Inlal  Valva  9aal 

1 

40 

960 

Has  Haad  Bolta'VS'30  a  long 

6 

45013  Inlat  Valva  Spring 

1 

41 

45006 

Baoo  Plato 

1 

45016  Inlat  Valva  Raialnar 

1 

43 

4  5009 

Baaa  Plata  Oaakat 

1 

16061  Haad  Belt 

3 

43 

9349 

Plpa  Pluf  V'*^'trnlahad  with  102.P500 

45005  Cyllndar  Haad 

1 

only 

1 

45006  Cyllndar  Haad  Oaakal 

1 

44 

9346 

Plpa  Plu« 

1 

31901  Platen  Rlnga 

3 

49 

9609 

Pipe  NIppla'V*  >  5*’’ Purnlahad  with  com- 

1  7063  011  Ring 

1 

praaaor  only 

1 

36933  Platon 

1 

46 

14393 

Plpa  Cap*\'’  Pumlahod  rith  coa^raaeor 

1 

13993  Wrial  Pin 

only 

7690  Wrial  Pin  Ratalnar  Waahar 

3 

47 

4503  7 

Crankcaaa  Plug 

45001  Ceruiacting  Red  Aaaantbly 

1 

Net  fhoam 

43797 

Parta  Llat 

45004  Crankcaaa  AaaambI y-Includaa  R*f  No.  3  7 

1 

aa 

49090 

Pulley  for  100  TV 

1 

45033  Tlvtwl  Waahar 

3 

a 

49051 

Cranbahaft  for  lOO  TV 

1 

45003  Crankahart  for  101  TV 

1 

Not  Shown 

45060 

Haad  Plato  Spacer 

3 

9397  Woodruff  Kay  No.  9 

1 

Not  Shoam 

45344 

Sat'Oaakata 

1 

45036  Brenaa  Buahlni 

1 

Hal  Shown 

49?37 

Sat'Rlnga 

1 

45010  End  Cover  Oaakat 

1 

Not  Wiaw 

45345 

Sal-Valva  h  Oprlng 

1 

lltsi  Braathar  Valva  ■craw-t-]2  a  %a" 

1 

SA-1530-57 

FIGURE  40  PARTS  LIST  FOR  THE  PUMP  UNIT 

B 


C 


- - - -  +X 

SA-3605-41 

FIGURE  41  ABUTTING  PARTS 


I 


- -  +x 

SA-3805-42 


FIGURE  42  ABUTTING  PARTS  NOT  SQUARELY  ALIGNED 

Here  C  does  not  r.^aliy  restrict  A's  moveFent  in  the  +X  direction. 
Many  parts  of  the  conoressor  are  lined  uo  souarely  one  aqalnst 
another^  so  that  this  kind  of  problem  often  does  not  arise  and  the 
simple  model  suffices.  We  intend  to  add  to  the  model  some  notion  of 
shape  and  position  so  that  such  cases  ca*-  be  recoarlzed  and  handled 
correctly.  The  semantics  of  assembiy/di sassemb] y  nroblems  suooests 
that  parts  are  usuaiv/  held  or  fastened  in  snecific  "canonical" 
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conf  iourat  1  ons  »  and  sub^sse'nh  1 1  es  dr**  set  dovn  in  stable  positions 
durinn  the  assembl  v/di  SflSspmb  1  V  process.  Th'is  it  nilaht  pe  ir  med 
that  tbe  model  need  not  represent  "lumbled"  conf  1  ai:rat  1  ons  sucn  as 
would  result  from  pushing  Part  ^  to  the  rloht  in  Fioure  47.  It 
would,  however,  be  desirable  for  the  system  to  recodnize  when  such 
"jumbled"  conf lourat ions  mlqht  occur,  and  warn  the  apprentice 
accor dinaiy . 


Besides  TYPE  an!  OlWKCTIPNS,  some  CdUNECT TOMS 
have  the  OMSP  propertv  sticky.  ^  true  value  of  this  property 
indicates  that  there  is  enouoh  lateral  friction  in  the  connection  to 
appreciably  restrict  freedom  of  movement. 


"slno  Fv  in  '  odeMno  and  Plannino 


Say i no  that  "part  R  restricts  part  A's 
freedom  of  movement  in  direction  +X"  is  equivalent  to  sayina  "if  vou 
push  part  A  in  direction  +X  vou  are  also  oushlnq  part  P  in  the  same 
direction".  lonorino  for  the  moment  th»  effects  of  nravity  and 
friction,  we  can  model  the  effects  of  push! no  part  A  In  direction  +X 
as  follows. 


we  find  all  the  parts  that  Immodiateiv 
restrict  A's  freedom  of  movement  in  direction  +X;  in  other  words, 
parts  that  have  CQMNFCTTnNs  vith  A  that  imoose  the  niven  restriction 
on  A's  FM.  Then,  for  each  such  part  we  find  any  other  parts  that 


•  •v'.v- 

V-'.' 'I--  ■  ■' 


-  ,*•  "•  -  .-V 
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Immedli^tplv  restrict  Its  F  m  the  +X  direction;  •‘e  continue  ftndlnn 
all  thP  parts  so  Intlupncpd  (i^eeplm  track:  of  which  parts  we  have 
already  nroc-ssed  so  that  we  do  not  net  caunht  in  an  infinite  loop). 
The  final  list  of  parts  contains  all  those  carts  that  also  oet  oiished 
In  the  +X  direction  when  wp  push  on  part  A. 

For  each  oart  P  found  by  the  above  alqorithrr, 
the  system  remembers  the  oath  of  cnMNFCTjnMs  oriolnatinq  from  Part  A 
dnd  leadinq  to  the  oiven  part  P.  This  oath  represents  a  tctnd  of 
cause  and  effect  chain  that  "explains"  whv  part  ^  has  to  move  when  we 
move  Part  A.  if  ^riy  link  in  this  chain  can  oe  broken  (by  alterlno 
one  Of  the  Individual  CCNMFCTinMs  in  such  a  way  that  the  alven  FM 
restriction  is  no  lonaer  imposed  bv  tnat  COMFFrTTDN  --  e.o.,  hy 
removim  a  fastener),  then  we  may  he  able  to  break  the  chain  of 
causality  Itself  and  hold  part  P  (and  all  narts  further  down  the 
chain)  stationary  while  we  move  Part  A  (and  all  the  Parts  between  A 
and  P).  This  tyre  of  analysis  can  oenerate  subooeis  for  the  removal 
and  Installation  of  Darts  without  havina  to  store  such  subooals 
exDllcltly,  For  example,  suppose  the  main  doal  to  he  achieved  Is  to 
remove  the  crankshaft  frnrr  the  pump.  m  order  to  remove  the 
crankshaft,  it  must  of  course  have  freedom  of  movement  in  some 
direction  with  respect  to  the  rest  of  the  pumo.  we  may  querv  the 
model  to  see  If  such  freedom  of  movement  already  exists.  If  not,  the 
model  can  return  a  sur^marv  of  which  chains  of  Darts  and  CONrJFCTlONs 
are  responsible  for  restrlctlno  the  crankshaft's  movement.  we  can 
then  propose  as  subooals  the  removal  of  thes®  restrictions,  usually 
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by  unfastenlna  anrt/or  removinq  intermediate  oarts.  Plans  aenerated 
In  this  fashion  may  entail  movlno  whole  "chunks"  of  oarts  at  onca» 
since  the  planner  first  achieves  freedom  of  movement  for  some  Part 
and  then  simply  moves  the  part  in  the  desired  direction  f. lono  with 
any  other  Parts  that  may  he  Pushed  atom  with  It. 

c.  The  MOVE  Function 

The  function  C^nvF  oattl  dir  part2llst) 
computes  the  effects  of  movinq  part  parti  in  direction  dir  while 
holding  the  parts  on  oartJlist  stationary.  The  actual  worklnas  of 
this  function  are  somewhat  more  complicated  than  is  indicated  above. 
It  takes  Into  account  that  if  one  part  supports  another^  then  the 
supported  Part  win  tend  to  follow  along  when  the  supporting  part  is 
moved  In  any  direction,  unless  the  supported  part  Is  explicitly  held 
back,  (In  the  latter  case  the  part  may  become  unsupported,  a 
condition  that  the  system  win  detect.)  Also,  some  restrictions  on  FW 
are  softer  than  others,  in  the  sense  that  they  can  he  overcome  hv 
applying  sufficient  force  to  the  parts  Involved,  An  example  of  a 
soft  restriction  is  a  force  fit,  or  one  Part  sticking  to  another. 

Suppose  that  the  ■►X  direction  In  the  above 
example  corresponds  to  "up"  in  the  real  world  (In  other  words,  we 
Introduce  a  force  of  gravity  Into  our  model  that  nulls  all  Parts  In 
the  -X  direction).  Then  the  chains  of  FM  restrictions  discussed  above 
may  Indicate  which  parts  are  supported  by  part  A,  It  Is  true  that 


restricts  moverrent  in  the  ur  direction"  is  not  always  svnonyn-ous 
with  "Is  sunrortei  by"  since  the  "supnortlnn"  nart  must  In  some  cases 
be  centered  under  the  other  rart  to  truly  sunnort  It.  The  current 
model  does  not  Include  anv  knowiedoe  about  whether  oarts  are  centered 
In  this  way.  ^t  some  cost  In  additional  comnut at  1 ona 1  complexity,  we 
can  add  such  Information  In  svmpollc  form,  or  nernans  ao  as  far  as 
derlvlna  It  from  a  three-dimensional  model  of  shapes  and  forces  [44], 


The  current  model  recoonlzes  (but  makes  no 
attempt  to  anaiyrel  the  case  o‘  an  obdect  suoborted  lolntlv  hv 
several  others.  However,  In  the  case  of  a  slnole  chain  of  FM 
restrictions  leadlno  from  a  ojven  ohiect  to  a  "support  ohdect"  (such 
as  a  table  or  the  apprentice's  hand)  we  can  treat  this  chain  as  the 
suDportlna  chain  for  the  obdect. 


F.ssential  ly,  the  wrivF  alqorlthm  works  by 
"orobina"  one  or  more  parts  m  a  aiven  direction  and  traejna  tprouah 
the  chains  of  hard  and  soft  FM  restrictions.  By  nroblna  the  part 
that  is  to  be  moved  In  the  direction  Indicated,  the  system  finds 
other  parts  that  must  move  as  well.  Bv  nroblno  the  parts  that  are  to 
remain  stationary  In  the  opposite  direction.  It  finds  parts  that  must 
remain  stationary.  Then  these  sets  of  Darts  are  Probed  upwards  to 
find  probable  chains  of  support,  and  warn  of  possible  loss  of  support 
that  may  result  from  the  move. 


If  the  system  flriis  that  the  desired  move  is 
Imoosslble  due  to  some  chain  of  hard  FV  restrictions,  the  followinn 
procedure  is  followed. 

Kach  local  restriction  maklnq  up  this 
chain  is  classified  eccordlno  to  the  local  precondl t ion ( s 1  that  must 
be  achieved  in  order  to  "undo"  the  restriction.  The  particular 
preconditions  that  appiv  are  determined  from  the  type  of  COMUFCT  , 
the  fastenlno  If  any,  and  the  direction  in  i«.hlch  the  parts  are  heino 
probed.  Table  5  summarizes  these  preconditions  in  the  estimated 
order  of  ircreasino  dlfficultv  to  achieve  them, 

When  two  parts  are  found  to  have  an  FM 
restriction  preventlno  a  desired  move,  local  subgoals  for  breaking 
the  chain  are  derived  and  ranked  as  indicated  in  the  table.  The 
present  pump  model  is  not  integrated  into  a  planner  (the  ranked 
subgoals  are  printed  out  on  the  termlnallj  but  the  application  to 
Planning  is  evident,  and  we  here  eventually  to  Incorporate  these 
techniques  into  the  NG^H  system  (see  Section  III.B,?), 

d.  The  FtSTHIC riOhS  Function 

The  function  (RESTRICTIONS  parti  part21 
computes  an  the  F^*  restrictions  imposed  on  parti  with  respect  to 
oart2,  (PfSTRIcTiomS  parti  oart2)  is  equal  to  (jRPnsiTF  ( RESTPIcTtous 
part2  parti)).  The  answer  is  returned  as  a  list  of  restricted 
directions,  a  subset  of  l+x  -X  d-Y  -Y  +Z  -Z),  RESTPICTTGns  could  be 


Table  5:  Preconditions  Penulred  to  Undo  Restrictions 


Probe 

Direction* 


Precondition  to 

Type  of  CnNNhXTTO'J  Undo  Restriction 


Away 

Restriction  Imoosed 

bv  a  fast?nlno 

1--Screw  out  fastener 

Away 

CnNNFrTlOu  of  tyoe 

SrRFWS-IM 

?--Screw  out  the  screwabie  part 

Away 

MFSHFS  or  SPINDLKS 

3--N*ove  the  parts  In  the  direction 

Permitted  by  MESH  or  SPINDI.F 

Toward 

ABUTS 

4--Move  one  part  laterally  with 

respect  to  the  other.  (The  best 

direction  Is  not  determined,  1 

Toward 

Fastened  or  RESHFS 

or  SPT  \IDLES  or 

screwed- IN 

S--Actlon  1 »  ?f  or  3  as 

appropriate,  followed  bv 

action  4 . 

♦Away  means  that  the  parts  onlv  need  to  be  dlsenaaaed  or  unfastened 
to  be  free  to  move  in  the  desired  direction.  Toward  means  that  the 
parts  would  ohyslcally  obstruct  each  other  if  moved  in  the  desired 
direction . 


computed  by  probina  nartl  In  each  of  the  six  directions  and  seelno  If 
It  moves  part2»  as  In  wavt:  above.  However#  this  approach,  aside  from 
belnq  Inefficient,  does  not  oenerallze  to  a  representation  in  wMch 
arbitrary  directions  are  allo^ied. 

Another  possible  aporoach  to  computlnn 
RESTHICTJONS  would  be  to  find  all  paths  of  CO^'NFCTlONs  between  parti 
and  rart2,  and  to  prooaaate  all  restrictions  throuib  each  of  these 
paths,  finally  tavclno  the  union  of  the  restrictions  Imposed  bv  all 
such  Paths  to  arrive  at  the  answer.  This  method  does  oenerallze  to 
the  case  of  allowlno  arbitrary  directions  (assumino  that  there  Is  a 
met  lod  of  oropaqatlnu  restrictions  throunh  a  oartlcoiar  cnur'F.r  TIUN )  • 
but  It  can  run  Into  a  combinatorial  explosion  of  the  number  of  oaths 
In  a  complicated  device. 

The  aloorlthm  actually  used  to  compute 
PESTPICTIONS  IS  a  variant  of  the  method  of  computino  an  naths,  the 
second  of  the  above  methods.  The  aloorlthm  taVes  the  form  of  a 
Search  throuqh  a  orarh  structure  In  wmch  the  nodes  are  parts  and  the 
edqes  CONNECTIOA's  ,  The  search  fans  out  from  parti  and  part2 
simultaneously;  FM  restrictions  on  oarti  and  part?  are  nropaqated  to 
other  nodes  as  the  search  proceeds.  The  node  chosen  for  expansion  at 
each  step  is  the  one  that  imposes  the  most  restrictions  on  Its 
"source*'  part  (either  parti  or  Dart2),  whenever  the  search  fannlno 
out  from  Parti  and  Part?  meets  at  some  Intermediate  node,  a  oath  Is 
completed  from  oarti  to  part?  and  new  restrictions  on  those  parts  may 


be  Imposed.  The  search  is  terminated  Immediately  as  soon  as  It  is 
found  that  nartl  and  rart2  are  riqidiy  nn<ed--l.a.,  have  no  freedom 
Of  movement  with  respect  to  each  other.  TMs  search  alaorlthm 
remembers  the  restrictions  imposed  by  a  particular  connection  Cso 
they  do  not  have  to  he  computed  more  than  oncel,  allows  those 
restrictions  to  he  "used  uo"  as  the  search  crooresses  through  a  given 
CONNECTION,  and  deletes  the  connection  from  the  search  when  its 
restrictions  are  completely  "exhausted". 


StlM  another  method  of  computing  FM 
restrictions  that  -le  have  not  implemented,  but  which  we  Plan  to 

investlqate  further,  entails  representing  the  f,v  between  two  parts  as 
a  bounded  linear  constraint  on  their  coordinates.  Then  a  standard 
linear  Programming  algorithm  mloht  be  used  to  find  the  constraints  on 
the  positions  of  a  particular  nalr  of  parts. 


An  Example 


We  win  now  give  a  brief  example  of  a  dialog 
between  the  user  and  a  system  that  models  the  air  compressor  pump. 
For  the  purposes  of  this  examoie,  the  model's  attention  is  confined 
to  a  subassembly  of  the  pump  consisting  of  the  crankcase,  head 
basket,  head,  head  cover,  filter,  filter-screen,  .long  head  holts. 
Short  head  holts,  and  head-bolt  spacers,  as  shown  .n  Figure  43.  in 
this  example,  minor  parts  such  as  the  bolts,  gaskets,  and  spacers  are 
represented  as  Individual  parts  in  their  own  right,  and  enter  into 
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HEAD-BOLTS/LONG  “ 
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FIGURE  43  A  SUBASSEMBLY  OF  THE  PUMP  UNIT 


the  FM  computations  as  such.  However,  the  model  can  also  be  made  to 

Iqnore  these  Parts  and  represent  their  effects  abstractly  In  terms  of 

f asteni nos . 

The  function  heGTn  resets  the  model  to  the 
fullv-assembled  conf laurat l on  and  ooes  into  an  Interactive  mode  m 
Which  It  accepts  mode  1 -channl na  commands  and  queries.  The  system 
uses  the  QLISP  context  mechanism,  and  so  is  aeneraijy  capable  of 
representlno  a  tree  of  various  hypothetical  world  states.  For 
simplicity,  HFGTM  hides  this  feature  bv  malntalnlnn  a  "current" 
context,  oushlm  this  context  whenever  the  state  of  the  model  is 

chanqed,  and  answerlm  queries  with  resnect  to  the  current  state.  in 

the  transcript  that  follows,  the  user's  Inpurs  are  In  upper  case  and 
always  follow  prompt  characters  (-  or  the  system's  replies  are 

usually  in  lowar  case  and  at  th-»  left  maroinj  explanatory  comments 
that  were  added  for  the  Purposes  of  this  discussion  are  Indented  and 
enclosed  in  brackets  f  ]. 

»-I^IITPUMP) 

(model  Initialized)  [Initializes  the  components  and  rONNECTIiiNs  of 

the  oump.i 

-BEGIN ) 

(State  of  pump  reset) 

enter  commands: 

RESTRICTinMS  HEAD-COVER  CRANKCASE 
(-X  ♦X  -Y  +Y  -Z  +Z)  [They  are  rioidiy  attached! 
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SCHFW-nUT  HFAD-BOI  TS/LO^IG 


HESTRTCTIDNS  HFAD-CnVFR  CPANKCASF 
(■♦•X  -X  -y  +z  -z) 


SCREW-OUT  HFAn-POT  TS/SHORT 


RESTRICTIClNwS  HFAD-COVER  CRANKCASE 


(-Y) 


TICHTEN  READ-POI-TS/LONt; 


riGHTF.M  HFAO-BUI  TS/SnnpT 


->  MOVE  FILTER  +¥  CRAMKCASF 


suhaoals  derlven  from  oath: 


((7  screw-oul  HFAD-ROLTS/LONG)  (S  nove  HE/D-CnVFP  f-Y)  HFAD-ROLTS/LONG  , 


move  HEAD-CCIVFP  C+X  -X  +Z  -Z)  HEA0-80LTS/L0NG )  (4  move  FILTER 
(+X  -X  +7.  -Z)  HEAD-COVER)) 

Freedom  of  movement  does  not  exist 

[now  the  user  plays  the  nart  of  the  olanner  and 
chooses  an  aoproprlate  subqoai.  The  number  at  the 
beolnnlncf  of  each  subooal  Indicates  Its  relative 
dl  flculty  to  achieve  according  to  the  table  In 
section  fc.)  above,  Tne.  first  alternative,  headed 
by  IS  derived  from  the  CONNECTION  between  the 


HEAD-BOLTS/LONG  and  the  CRANKCASE,  The  next,  header 


hv  "S",  comes  from  [CONNECTION  HEAD-BOLTS/LONG 


HEi\n-CnnFP) .  The  Mst,  hP-Jded  by  "4",  romes  from 
(CnV'NKCTTON  FI  MEW  HE  A  D -CH  VFP  )  .  J 
->  SCRFW-nUT  HFAD-HUlTft/Li">iNjG 

[The  user  cbooses  the  first  siibuoal 
o»< 

^  ML1VF  FILTER  fY  CRANKCASE  [...  ^nd  tries  flnaln.l 
formlno  chunF  of  moved  oarts  consistlno  of 

(  REAn-RIlLTS/LOMC.  HFAD-C^VER  FILTER  F  ILTFR-SCREEN  ) 

[The  filter-screen  oets  carried  ajom  because  it 
stlcics  to  th®  filter,] 

enter  list  of  other  moved  Darts  that  form  new  connections  with  TABLE: 

->  (HFAD-cnvF.R )  fThe  model  lacks  the  oeometric  information  to 

ft  nil  re  this  out  for  Itseif.l 
formind  new  chunk  of  stationary  parts  conslstind  of 
fCHANKCASF  HEAD  HEAD-HOLTS/SMORT  HEAD-GaSKET  HEAD-SPACERS  TABLE) 
new  loose  ends  are* 

((CONNECTION  FTITER  HEAD)  (CONNECTION  FILTER  HFAD-SPACERS )  (CONNECTION 
HEAD  H*’.AD-COVER )  (CriNNECTIOV  HEAD-COVER  HEAD-SPACERS)  (CONNECTION 
CRANKCASE  HEAD-BOr.TS/LOMC, )  (CONNECTION  HEAP  HEAO-POLTS/l.ONG )  (CONNECTION 
HEAD-BOLTS/LONG  HEAP-SPACERS  )  (CONNECTION  HE AD-BOLTS /LONG  HFAD-GASKFT) 
(CONNECTION  F  IT.TFR-SCRFEN  HEAP)) 

warning  --  the  following  oarts  may  become  unsupported: 

(HFAD-BULTS/LONG  FIlTFR-SCREEN  HK'AD-COVFR) 

ok 


STOP 


f.  Continuing  woric 

The  slTiPle  oump  model  fiescrlbed  above  has 
served  as  a  test  of  f r eedon-o f -Tove"nenf  as  a  Tioiellno  tool.  Vve  are 
Working  to  develop  a  better  understanding  of  the  serrantirs  of  freedoir 
of  tTioveoent  and  nore  oeoeral  r^nresentat  1  ons  of  FV  restrictions. 
These  concepts  will  be  inror:jor,gtAd  to  the  model  of  the  compressor 
and  in  models  of  other  devices  that  mav  be  dealt  with  in  the  CPC 
project . 


■Je  ar®  beginning  to  examine  the  relationships 
between  the  geometric  device  models  being  used  for  vision  and  dlsoiav 
(see  Section  11, Cl  and  the  more  symbolic  models  used  for 
assembly-disassembly  planning,  with  an  eve  toward  automating,  as  much 
as  possible,  the  creation  of  similar  reresentat 1 ons  for  new  devices. 
Perhaps  the  user  can  characterize  a  new  device  ny  the  nature  of  the 
CDdNECTlQNs  between  its  parts  (as  In  the  pump  model  described  above) 
and  the  general  shapes  of  the  parts,  using  some  visual  Input  where 
necessary.  If  tha  system  had  a  tnree-d Imens I ona i  shape  model  (even  a 
crude  one)  and  a  cl  ass  1 1  Icat  Ion  of  Inter-part  rDNNFCTItiNs  (ftPUTS, 
SPTNDTjFvP,  and  the  like).  It  coul'^  derive  freedom  of  movement  and 
access  Information,  This  in  turn  could  vleld  planner  preconditions 
for  assemhiv  and  disassembly  actions. 


Toese  investigations  raise  manV  of  the  Issues 


prevalent  In  current  A.l,  research  relating  to  "world  knowledge 


how  It  IS  acooired,  how  to  renresent  it  Intem^llY,  how  to  retrieve, 
orqanlze  and  imdate  It.  m  me  CPC  domain,  we  win  esoeclallv 
confront  the  need  to  renresent  the  same  device  from  different  nolnts 
Of  view  for  different  n-irnoses  such  as  display,  vision, 
assemblY/dlsassembly  Plannlna,  and  natural  lanauane  Interaction. 
Particular  solutions  to  these  problems  In  the  CRC  domain  nay  shed 
some  linht  on  the  lamer  Issues  Involve!. 

2»  Diagnosis  of  Equipment 

3.  Background 

The  use  of  computers  to  help  diagnose 
malfunctions  In  noulpmont  and  to  help  dlaonosa  diseases  In  humans 
already  has  an  extensive  nlstory.  Notable  examples  are  system:  that 
dlaqnose  blood  Infections  lUJ,  systems  that  locate  faults  In 

dldltal  circuits  (451,  and  systems  that  locate  faults  In  Internal 
compustion  engines  146]. 

Several  approaches  to  computer  diagnosis  have 
been  stUuied/  and  we  snail  briefly  mention  three  of  them  here.  Twj 
approaches,  using  "truth  tables"  and  using  "decision  trees,"  have 
parallels  in  pattern  recoqnltion  technology.  A  third,  the 

"rule-based"  approach,  stems  from  heuristic  programming  techniques  in 
Artificial  Intelligence. 


The  so-cailed  trutn  table  method  entails 
collecting  a  number  of  simultaneous  measurements  from  the  system 
being  diagnosed.  We  might  represent  these  measurements  oy  an 
n-dlmens lonai  vector  X»  where  n  is  the  number  of  measurements  made. 
Then  an  analysis  is  made  of  the  effects  on  the  vector  X  of  various 
faults  that  might  occur  in  the  system.  In  the  simplest  case  each 
possible  fault  has  a  unique  effect  on  X.  For  example*  a  perfectly 
functioning  system  might  give  rise  to  tne  vector  Xo.  Each  different 
fault  gives  rise  to  a  distinct  vector  X;  for  example*  the  1-th  fault 
gives  rise  to  vector  XI.  This  association  between  faults  and  vectors 
can  be  stored  in  a  table.  In  diagnosis*  one  enters  the  table  using 
the  measurements  X  to  find  the  associated  fault. 

In  more  complex  cases  the  mapping  between 
faults  and  measurements  Is  not  one-to-one.  This  presents  a 
difficulty  when  the  same  measurement  vector  X  could  have  been  caused 
by  a  number  of  different  faults.  In  the  latter  case*  common  In 
medicine*  It  Is  customary  to  collect  a  large  amount  of  data  In  order 
to  estimate  the  probabilities  p(X/fauit)  and  then  to  use  Bayes'  rule 
to  calculate  the  a  posteriori  probabilities  pCfault/X),  standard 
decision  theory  techniques  can  then  oe  used  to  decide  on  tne  fault 
given  any  measurement  vector  X, 

The  decision  tree  approach  locates  the  fault 
by  using  measurements  In  '■•equence  instead  of  simultaneously.  It  is 
like  the  game  of  "twenty  qv-  tlons."  Depending  on  the  result  of  the 
first  measurement*  another  measurement  Is  selected.  Its  result  in 


turn  determinc's  another  measurernent »  and  so  on.  The  alternative 
measurements  can  be  Pictured  as  a  tree.  The  Identities  of  the  faults 
are  located  at  the  tips  of  the  tree^  i,e,,  after  the  final 
measurements  in  each  sequence,  Un  the  aVeraoe»  this  approach 
requires  fewer  measurements  than  the  truth  taole  approach,  but  like 
all  sequential  procedures  has  little  tolerance  for  errors  In 
measurement , 

Several  prcblems  with  these  "classical" 
methods  have  motivated  a  search  tor  some  alternative  approach  to 
diagnosis,  in  particular#  we  might  mention  the  following: 

(1)  Data  gathering.  The  data  needed  for  the 
truth  table  method  are  very  often 
statistical.  Large  antounts  must  be 
gathered  under  carefully  controlled 
conditions.  Much  more  easy  to  gather  are 
tne  "distilled"#  "Judgemental"  data  used 
by  skilled  diagnosticians.  Often  this 
Information  is  in  the  form  of  simple 
rules  like;  "it  symptom  X  is  present# 
then  the  trouble  Is  likely  to  be  Y," 

An  argument  can  be  made  that  the 
diagnostician  himself  uses  rules  of  this 
sort  In  his  own  information  processing 
procedures  leading  to  diagnosis#  and# 


In  particular,  does  not  explicitly  use 
tables  or  Bayes'  rule.  Presumably  it 
Would  be  more  effective  and  efficient  to 
extract  tnese  useful  rules  by  intervlewinq 
s<llled  practitioners  rather  than  to 
gather  raw  statistical  data, 

Extendibll I ty .  Statistical  data  are  not 
easily  extendible  to  slightly  different 
problem  areas  or  to  situations  in  which 
new  measurements  are  discovered  to  oe 
useful.  Each  new  problem  area  or  advance 
in  technique  would  have  to  be  accompanied 
by  another  extensive  statistical  analysis. 
Decision  trees  are  similarly  hard  to 
modify  to  Include  a  new  measurement. 
Generally,  the  whole  Iree  must  be 
redesigned,  we  would  like  a  technique 
that  can  easily  grow  to  Include  new 
Information , 

Interaction,  The  classical  methods  do 
not  allow  a  human  expert  to  Interact 
with  the  diagnostic  process  In  any 
flexible  way.  In  the  truth  table 
method,  once  the  measurements  are  input, 
the  process  takes  complete  control 


until  a  decision  Is  announced,  A 
human  user  cannot  Interrupt  It  to 
contribute  any  additional  information 
that  might  be  relevant.  With  decision 
trees,  the  numan  user's  role,  if  any, 
is  limited  to  answering  questions  about 
the  results  of  any  of  the  measurements 
that  are  not  made  automatically.  The 
human  cannct  volunteer  any  new  intormatlon 
but  must  patiently  wait  until  and  it  it 
is  requested,  we  desire  a  system  that 
can  be  interrupted  wnen  the  user  thlnKS 
he  has  important  additional  information. 


Transparency,  The  classical  methods 
arrive  at  decisions  tnat  cannot  always 
be  explained  to  the  satisfaction  of  a 
skilled  user.  This  is  because  the  user 
i&  likely  to  think  in  terms  of  judgemental 
concepts  or  rules  as  described  earlier. 
When  queried  about  a  decision,  all  the 
classical  methods  can  do  is  state 
obscure  statistical  facts  or  present 
details  about  the  structure  of  underlylnq 
tables  or  trees,  We  want  a  system  that 


"thinks"  like  a  practitioner  so  that  it 


can  explain  Its  cnaln  ot  deductions  In 


terms  understandable  to  a  practitioner. 

In  order  to  meet  these  criteria^  we  have  been 
thinking  about  designs  stemming  from  Al  reseaj ch  on  rule-based 
systems.  A  good  example  ot  such  a  system  (even  tho.'gh  It  does  not 
meet  criterion  3  above)  Is  the  MKCIN  medical  diagnosis  system  of 
Shortllcfe  [14],  Our  tentative  design  outline,  to  be  described  In 
the  next  section,  Is  similar  In  spirit  to  MVCIN,  although  the 
mechanisms  of  operation  are  different  and  It  will  be  an  Interactive 
system . 


b.  System  Design 

Although  our  work  on  diagnosis  Is  still  In  an 
early  stage,  we  have  developed  a  tentative  design  and  have  done  some 
Initial  programming  to  test  it. 

The  diagnosis  process  begins  with  a  statement 
of  a  "presenting  symptom"  from  the  apprentice.  Based  on  this 
Information  a  list  of  hypotheses  aoout  probable  faults  that  might  be 
causing  the  symptom  Is  generated.  A  probability  Is  associated  with 
each  of  these  faults. 


The  fault  hypotheses  are  generated  by  using 


rules  of  the  form 


"It  the  symptom  Is  X,  the  fault  Is  likely 


(probability  =  p)  to  he  Y."  Actually  each  rule  is  a  small  proqram 
that  can  perform  any  necessary  computations  required  to  set  up  the 
hypotheses.  Our  idea  is  that  tne  rules  i»/ill  oe  written  In  close 
collaboratior  with  skilled  diaqnostlcians . 

In  diaqnosinq  a  larqe  system  there  are  many 
levels  of  symptoms  and  faults.  Suppose,  for  example,  that  we  are 

diaqnosinq  a  malfunctioninq  automobile.  A  symptom  miqht  be  that  the 
enqine  does  not  start.  A  "hiah-level "  explanation  miqht  be  that  the 
iqnition  system  is  faulty.  At  a  somewhat  lower  level  of  the 
hierarchy,  the  symptom  might  be  that  the  ignition  system  does  not 
work,  and  the  fault  miqnt  be  that  the  spark  Is  too  weak.  Continuing 
down  the  hierarchy,  we  might  finally  learn  that  the  spark  plugs  are 
dirty. 

Our  diagnosis  system  is  being  designed  at  the 
start  to  work  on  a  hierarchical  basis.  Each  symptom  is  presumed  to 
be  caused  by  faults  of  an  appropriate  level,  which  in  turn  describe 
symptoms  caused  by  lower  level  faults. 

After  a  list  of  fault  hypotheses  is 
generated,  one  of  them  is  chosen  as  worthy  of  testing.  Currently,  we 
are  selecting  the  most  probable  hypothesis,  but  we  are  open  to  using 
a  more  sophisticated  criterion.  After  a  hypothesis  is  selected,  we 
refer  to  another  set  of  rules  telling  us  how  to  test  for  it.  Tnese 
rules  are  called  "handlers,"  They  are  of  the  form:  "If  Y  Is  a 
suspected  fault,  use  test  T,  and,  depending  on  the  outcome,  modify 


the  probability  of  Y."  Again#  the  rules  are  small  programs  that  can 
perform  any  computations  needed  to  help  specify  the  test  and 
interpret  Its  results.  A  choice  between  competing  handlers  tor  the 
Same  hypothesis  can  oe  made  on  the  basis  of  oenetlt/cost  ratios  of 
the  associated  tests.  The  result  of  applying  a  handler  Is  to  modify 
the  probabilities  of  tne  hypotheses,  (A  test  may  give  Information 
about  hypotheses  other  than  the  one  for  which  It  was  chosen;  we  will 
use  "demons"  to  catch  such  additional  Information.)  we  now  loop  back 
tnrouah  the  main  progiani,  select  the  now  most-oronable  hypothesis# 
select  a  handler  for  it#  and  so  on,  A  trap  condition  allows  us  to 
exit  whenever  the  probability  of  one  of  the  hypotheses  exceeds  some 
threshold.  This  hypothesis  is  then  decided  upon  as  the  fault. 

Depending  on  the  apprentice's  sicllls  and 
desires#  this  fault  decision  may  or  may  not  be  the  final  answer  to 
his  diagnostic  problem,  if  he  needs  more  detailed  Information#  he 
may  re-enter  the  fault  Just  computed  by  the  program  Into  the  system 
as  a  symptom.  Tne  process  then  uses  a  set  of  finer-grained  rules  to 
give  a  more  detailed  explanation  of  the  fault, 

K^e  envision  the  system  working  In  the 
hierarchical  fashion  just  described#  punctuated  by  outputs  to  the 
apprentice  and  restarting.  Even  so#  there  may  be  .  reasons  why  the 
system  might  want  to  descend  a  few  levels  on  Its  own  to  help  make 
more  definite  conclusions  about  higher  level  faults.  That  Is#  before 
deciding  definitely  that  a  higher  level  hypothesis  is  correct#  the 


system  may  on  Its  own  test  some  of  the  subhypotheses  explaining  the 

higher  level  one  as  a  way  of  confirming  or  refuting  the  higher  level 
one , 

We  have  written  an  Initial  UL^SP  program  to 
test  some  of  these  Ideas  and  have  applied  it  to  problems  of 

diagnosing  some  simple  electric  circuits.  After  we  finally  decide  on 
a  more  complex  piece  of  eguipment  to  reolace  the  air  compressor,  we 
Intend  to  Implement  a  much  larger  diagnosis  system  for  that 
equipment.  We  also  still  must  face  several  Important  questions 

Involving  multiple  faults  and  intermittent  faults,  We  wm  oe 
postponing  the  matter  of  how  to  repair  faults  until  we  maice 

substantially  more  progress  on  the  diagnosis  problem. 

Our  description  of  the  operation  of  the 

hypothesis  handlers  glossed  over  the  guestlon  of  how  probabilities 

are  to  be  modified  as  a  result  of  the  tests.  This  Is  an  important 
and  no..<-riviai  problem,  We  have  adopted  a  Bayesian  approach  to  this 
matter  that  Is  discussed  in  some  detail  In  the  next  subsection, 

c.  Alternative  Forms  of  Bayes'  Rule  for 

Didgnos is 

Introductory  Remarks 

The  use  of  Bayesian  decision  theory 
Is  popular  In  medical  diagnosis  147,48,49],  and  has  a  natural  appeal 


In  any  diagnosis  problem  in  which  one  has  suggestive  but  not 
compelling  evidence  to  support  various  hypotheses.  As  Shortllffe  has 
pointed  out  150J»  direct  use  ot  Bayes'  theorem  Is  not  without  serious 
drawbacks.  These  problems  are  particularly  severe  when  there  Is  no 
cause-and-etf ect  models  and  when  correlations  between  the  joint 
occurrence  of  a  set  of  evidence  and  the  nypotheses  must  be  estimated 
from  data,  Shortllffe  and  Buchanan  tSlJ  give  additional  arguments 
for  the  inappropriateness  of  Bayes '  theorem  In  rule -based  diagnosis 
systems,  and  advocate  their  version  of  confirmation  theory  that 
substitutes  certainty  factors  for  conditional  probabilities. 

This  subsection  presents  several 
variants  of  Bayes'  theorem,  some  ot  wnich  are  very  similar  to 
Shortliffe's  certainty  factor  formulas.  The  variants  are  apprcprlate 
under  different  circumstances,  i^<e  begin  with  the  simplest  case  of  a 
single  hypothesis  and  binary-valued  evidence, 

11)  Bayes'  Rule  for  Events 

Let  H  be  a  hypothesis  that  is  either 
true  or  false,  and  let  E  be  a  niece  of  evidence  that  either  is  or  Is 
not  present,  We  view  E  and  H  as  random  events,  writing  PCK)  as  the  a 
priori  probability  of  the  occurrence  of  event  E,  P(H)  as  the  a  oriori 
probability  of  event  H,  and  P(E,H)  as  the  joint  probability  of  L  and 
H,  l,e,,  the  probability  of  the  event  EAh,  For  the  nonoccurrence  ot 


E  or  H,  we  write 


Q(E)  =  P(E)  =  l-P(E) 


CCl 


and 


Q(m  -  r(H)  =  l-p(H)  . 

For  the  joint  probaolllty  function,  we  -r.ust  know  three  of  the  tour 
probabilities  P(t,H),  F(£:,h),  P(F,h)  and  P(r,H).  By  the  law  of  total 
probao^llty,  P(E)  and  P(H)  can  oe  derived  from  the  complete  joint 
probaolllty  function  oy 


P(E)  =  P(E,H)  +  P(E,E)  (C3) 

P(H)  =  P(E,H)  +  P(E,H) 

(Cn 

The  conditional  probability  P(E\H)  is 

defined  as 


P(e|h)  = 

P(H) 


(C5) 


Similarly, 


with  analogous  formulas  for  P(L\H)  and  P(h\l).  now,  typically,  we 
either  know  or  can  estimate  both  P(t;\H)  and  P(f\h),  we  obtain  the 
evidence  E,  and  we  wish  t.c  update  the  proDabillty  of  h  from  the  a 
priori  value  P(H)  to  the  a  posteriori  value  P(H\e).  Hayes'  rule. 
Which  follows  Immediately  from  the  above  formulas,  provides  the 
desired  answer: 


P(h|e)  =  —  - 

P(E  H)P(H)  +  P(e1h)P(H) 


(C7) 


ill)  Some  Useful  Variants 


Define  the  likelihood  ratio  by 


A(e|h) 


P(E  H) 
P(E  ii) 


and  let  the  ratio  0(H)  be  the  odds  favoring  hypothesis  H, 


0(H)  .  fffli  .  EM 

P(H)  Q(H)  ■ 


Then  we  can  rewrite  tq.  tC7)  as 


P(h|e)  = 


AO  +  1 


(CIO 


-  *•  %  ,  .  • 


Tnus,  the  a  posteriori  probability  can  be  determined  from  tne 
likelihood  ratio  and  the  a  priori  odds.  Alternatively,  if  we  use  the 
fact  that 


p(h|e)  =  1  -  p(h|e)  = 


and  define  the  a  posteriori  odds  oy 


0(h1e)  = 


P(H 

Ei 

P(H 

E) 

(Cin 


then  we  obtain  the  simple  formula 


0(h|e)  =  A(e1h)  0(H)  (Cl  2) 

This  formula  Is  sometimes  called  the 
odds-ilkellhood  formulation  of  bayes'  rule  152J  .  It  shows  how  the 
odds  favoring  a  hypothesis  change  when  new  evidence  Is  obtained.  For 
our  purposes,  It  is  pernaps  the  most  useful  form  of  Bayes'  rule,  it 
suggests  a  simple  recursive  updating  procedure  that  win  be 
elaborated  In  Subsection  v  oelow.  To  recover  the  probabilities  from 
the  odds,  we  merely  use  the  formulas 


P(H)  = 


0(H) 

0(H)  +  1 


(Cl  J) 


231 


and 


P(h1e)  = 


OfH  |e) 
o(h|e)  +  1 


(C14) 


iv)  Objections  and  Problems 

ihere  are  two  basic  problems  in  uslnq 
tnese  results.  The  traditional  objection  concerns  the  a  priori 
orobabllltles ,  If  H  Is  the  hypothesis  of  an  event  that  has  never 
been  known  to  occur  naturally#  then  even  though  we  may  be  able  to 
force  H  to  occur  and  thus  determine  P(E\H),  there  may  not  be  any 
Objective  way  to  determine  P(H),  Although  this  can  be  viewed  as  a 
philosophical  cjjectlon  to  the  whole  approach,  the  degree  of 
seriousness  of  the  problem  has  often  been  overstated.  Even  If  h  Is  a 
rare  event,  so  that  P(H)  is  small  (but  not  zero),  P(H\E)  can  be 
significantly  large  If  the  evidence  E  Is  sufficiently  strongly  linked 
to  H,  In  particular,  we  see  from  Eg,  (10)  that  P(H\E)  will  be  near 
unity  If  AO  Is  much  greater  than  unity,  l.e,,  If  A  >>  1/P(H)  when 
P(H)  is  small. 


This  leads  Is  to  a  second  and  more 
Serious  problem.  It  is  obvious  that  the  evidence  is  effective  In 


confirming  h  If  and  only  If  It  is  much  more  likely  to  be  obtained 
when  H  Is  true  than  when  H  Is  not  true.  Unfortunately#  while  It  may 
be  Possible  to  get  a  very  reasonable  estimate  tor  P(FAH),  it  is  often 


very  nard  to  estimate  P(b;\H).  Consider,  for  example,  the  case  In 
Which  H  Is  the  hypothesis  that  a  particular  car  Is  out  ot  gasoline, 
and  the  evidence  fc!  is  that  the  car  win  not  start.  Clearly,  P(fcAH) 
Is  very  near  unity,  but  what  Is  P(E\H)?  The  problem  is  that  H  is  not 
a  simple  hypothesis  put  a  compound  hypothesis.  There  are  many 
possible  reasons  for  the  car  not  starting.  lAinlle  we  may  be  able  to 
estimate  the  probability  of  E  given  any  one  of  them,  we  may  find  it 
hard  to  account  for  their  Interactions,  and  we  may  not  even  pe  able 
to  think  of  all  of  the  possible  explanations. 

Thv'?  oroblem  we  face  here  Is  not 
unlike  the  problem  that  Shortllffe  faces  In  assigning  confidence 
values  to  his  diagnosis  rules.  Suppose  that  we  have  a  uie  such  as 
'It  the  car  win  not  start,  tnen  there  Is  sugrestlve  evidence  that 
the  car  is  out  of  gas."  Should  we  assign  tnls  rule  a  confidence  of 
0,1  (weakly  suggestive) ?  0,5  (suggestive)?  o,8  (strongly 
suggestive)?  Shortllffe  relies  on  the  expert  to  make  this  decision. 
Presumably,  the  expert  has  encountered  many  cars  that  win  not  start, 
and  has  a  rather  good  Idea  of  what  can  be  concluded. 

When  necessary,  we  adopt  a  similar 
attitude  toward  the  likelihood  ratio,  Even  though  the  expert  may  be 
hard  pressed  to  give  good  numerical  estimates  for  either  P(L\H)  or 
P(E\H),  We  boldly  assume  that  the  expert  can  auantify  subjective 
feelings  about  the  strength  of  the  relation  between  a  hypothesis  and 
some  evidence  by  olvlng  reasonable  numerical  estimates  tor  the 


loq-1 ikellhood  ratio 


L(e1h)  =  log^^  A(e1h)  . 

Trie  loq-1  i  ke  1  Ihood  ratio  Is  of 
Interest  for  several  reasons.  It  has  been  found  to  be  advantaqeous 
In  at  least  some  experiments  In  which  people  are  asked  to  estimate 
likelihood  ratios  [53J.  Mathematically#  the  use  of  loqarlthms  turns 
the  odds-llkel Ihood  formulation  of  Bayes'  rule  into  an  additive  form 

log  0(h(e)  =  L(e1h)  +  log  0(H) 

Thus,  L(E\H)  Is  an  additive  measure  of  the  "Information"  that  L  gives 
about  H,  If  li  Is  positive,  d  Is  more  likely;  If  L  Is  negative,  H  Is 
less  likely;  It  the  evlaence  is  Indifferent,  L  =  0,  The  actual 
numerical  value  of  L  depends  on  the  choice  of  the  base  for  the 
loqarlthm.  In  most  of  our  work  we  have  used  a  base,  b,  of  1,5.  With 
this  arbitrary  choice,  the  ranqe  from  -10  to  flO  for  L  cor’^esuonds  to 
a  range  of  about  i/60  to  f>0  for  A. 

V)  Sequentially  Acquired  Evidence 

Suppose  that  we  have  previously 
obtained  n  -  1  pieces  of  evidence  El,  En-1  and  that  we  know 
P(H\E1,  ,,,,  En-1),  or,  equivalently#  tne  odds  0(H\E1,  ...#  En-l).  we 


can  treat  these  as  prior  probabilities  (or  odds)  when  a  new  piece  oi 


evidence  Kn  Is  obtained,  Ihus#  we  can  rewrite  Eq,  (C12)  as 


0(h|Ej,  E^)  =  A(E^|h,E^,  K^_^)0(H  IEj^,  ...,  E^_^) 


(C17) 


where 


P(En|H,E^, 

*'  "  P(E  |h,E  ...,  E  ,) 

n  i  n-i 


'  =„-i) 


(ClBl 


This  shows  how  C(H\lri,  tn-1)  can  be  updated  recursively  to  yield 
u(H\F.  1,  ...»  En),  Alternatively,  we  can  iceep  all  n  pieces  of 
evidence  grouped  together  and  rewrite  Eg,  (C121  as 

0(h|e^,  E^)  =  A(Ej^,  E^Ih)O(H)  (C19) 


Where 


A(e^ 


} 


EnlH) 


P(Ej^,  E  1h) 

^^^1.  •••,  \|h) 


(C20) 


However  we  write  these  expressions, 
one  fact  always  remalns--the  lixeilnood  ratio  depends  on  all  n 
pieces  of  evidence.  In  that  idyllic  world  in  which  the  pieces  of 
evidence  are  conditionally  Independent,  so  that  P(En\H,  ti,  ,,,, 
En-1)  s  P(En\H)  and  P(Lm\H,  El,  ,,,,  En-1)  =  PCEnNH’),  we  obtain 

0(h|Ej^,  E^)  -  A(e^  |h)o(h|e^,  E^_p  (C2n 
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P(E  H) 
n 


Alternatively*  we  have 


o(h|e^, 


E  )  =  A(E,,  E  |H)0(H) 

n  1 


(Ciy) 


with 


E  |h)  =  n  A(E,  !h) 
"  i=l 


n  P(E^|h) 

■  i" 


(C2i) 


(C24) 


Vi)  Combining  Independent  A  Posteriori 

Probabilities 

Suppose  that  we  had  some  good  method 
for  estimating  the  probability  of  hypothesis  H  given  just  the  single 


piece  of  evidence  E.  Let 


Note  that  the  a  posteriori  odds  increase  whenever  the  odds  cased  on 
En  alone  exceed  the  a  priori  odds.  It  follows  that  the  a  posteriori 
probability  increases  Whenever  P(H\En)  >  P(H).  If  we  express  the 
odds  in  terms  of  probabilities,  we  obtain 


p(h|e^, 


E  ) - 

n 

1  + 


n 

i=l 


1 _ 

Q(HjE^)P(H)  ■ 

P(HjE~)Q(H) 


mi 

P(H) 


1 

Q(h|e^)Q(h1e^,  E^_^)P(H) 

P(h|e^)P(hIe^,  E^_^)Q(H) 


(C3n 


Note  that  for  the  special  case  n  =  1 
we  merely  obtain  the  identity  P(H\En  =  P(H\Fn,  The  case  n  =  2  gives 


pChIEj^^e^)  = 


_  1  _ 

Q(H|E2)Q(h|Ej^)P(H) 

^  P(h|E2)P(H|Ej^)Q(H) 


(C3?l 


This  can  actually  be  interpreted  as  the  general  case  it  we  think  of 
El  as  the  collection  of  all  of  the  old  evidence  and  E2  as  the  new 
piece  of  evidence.  The  graph  in  Figure  44  shows  how  P(H\tl,E2) 
changes  with  P(H\E2)  for  the  special  case  P(H)  =  1/2. 
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SA-3805-32 


FIGURE  44  THE  EFFECT  OF  NEW  INDEPENDENT 

EVIDENCE  ON  THE  A  POSTERIORI  PROB¬ 
ABILITY  OF  H 


Vi  i  ) 


Helatlon  to  ShortUffe's  Combinlnq 
t'  omul  a 


Additional  variants  can  be  obtained 
by  introducing  a  quantity  C  that  Is  analogous  to-though  not  exactly 
the  same  as— Shortiif te's  certainty  factor  CF.  in  general,  for  ahy 
probability  p  *e  define  C  as 


C  =  2P  -  1 


(C33) 


Thus,  as  P  varies  from  u  to  1,  C  varies  from  -t  to  1.  After  a  little 
algebraic  manipulation,  mb  can  express  Eg,  CC32)  as 
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CC34) 


c,  +  +  C^C^) 

V2  •  ^2'> 


where 


C^  =  2P(h1e^)  -  1 


(C35) 


=  2P(h1E2)  -  1 


(C3b) 


and 


Cq  =  2P(H)  -  1 


(C37) 


It  Is  Instructive  to  consider  some 
special  cases.  If  all  of  the  C's  are  strictly  between  -1  and  1»  then 
it  is  easy  to  show  that 


“*  1  as  -*  1 

or  as  -•  1 

or  as  C  -*  -1 


anil  that 


C(h[e^^  E^)  "*“1  as  -  -1 


or  as  C  -  -1 
2 


or  as  C  -*  1 
0 


The  limiting  behavior  tor  Cl  and  C2  seems  quite  proper*  but  the 
behavior  tor  CO  at  tirst  seems  paradoxical.  if  we  are  virtually 


certain  a  priori  that  H  Is  false  (CO 


•1)*  why  should  we  be 


convincea  that  H  is  true  a  posteriori?  The  explanation  is  that  if 
P(H)  Is  approaching  zero  out  p(h\e1)  or  p(H\e2)  stay  bounded  away 
from  zero*  then  the  evidence  In  favor  of  M  is  extremely  convincing. 


For  the  special  case  P(d)  =  1/2  we 


obtain 


C(H|Ei,  E^)  =  ^ 


c,  +  c. 


(C3B) 


or*  alternatively* 


*'•  ■*.  ~  O*  ‘  **•'  '*•  *'•  **"•*  ^  "0  S'  S'  ’  •  "• 

^  V  'J- '.•-■■■.V.V.  -  ■  ■  •  1 

•  ^  T  *'*'  N*"  >*  V  _r**  ’**  •>"  /‘i’’.  \  }  }  ■' 

‘  V O.  s  s  y 


/  •  “>  -  V  •  •  <•  w\A  •  ‘ 


cchIe^^e^)  =  +  c^d  -  c^) 

+  [i  -  cchIe^^e^)] 

«Ci  +  C2(1  -  r^) 

if  C(H\tl,L‘2)  is  near  unity,  mis  latter  expression  is  reminiscent 
of  Shortlifte's  formulas  for  updating  measures  of  belief  and 
disbelief  for  Sequentially  acquired  evidence.  Tnus,  to  first  order, 
we  can  think  of  Shortlitfe's  formulas  as  an  approximation  to  B:q, 
(C38),  Which  in  turn  is  for  the  special  case  ot  independent  evidence 
with  F(H)  s  1/2. 


However,  the  appr ox imat ion  is  not 
good  if  Cl  and  C2  have  opposite  signs,  corresponding  to  conflicting 
evidence.  For  example,  suppose  that  Cl  <0  and  C2  >  0,  In  this 
circumstance,  Shortlltfe  would  say  that  El  favors  disbelief  in  h  and 
E2  favors  belief  in  H,  and  would  write 

MB(H,  E^)  =  0 


MD(H,  E^) 
MB(H,  E^) 
MB(H,  E^) 
MB(H,  E^  &  E^) 


0 

MB(H,  E^)  - 


MD(H,  E  &  E  ) 


MD  (H,  E  )  -  -C. 


provided  that  neither  C2  nor  -Cl  Is  unity.  The  certainty  factor  Is 
Obtained  as  the  difference  of  these  measures  of  belief  and  disbelief: 

CF(H,  &  E^)  “  +  ^2 

Note  that  this  leads  to  a  curious 
discontinuity  In  the  henavlor  of  the  certainty  factor.  If  ci  =  -l/2» 

then  the  laroest  Cf’  can  become  as  C2  a'r^oroaches  unity  is  1/2; 
however,  In  the  special  case  C2  =  1,  ShorclMfe  sets  MD(h,  tl  ^  £2) 
to  zero  and  obtains  CF  =  i.  This  aVKWard  llmltlno  behavior  is 
avoided  by  tq.  (C38)  (and  by  the  other,  more  general  formulas  we  have 
deri/ed),  In  which  C(H\El,t2)  approaches  unity  continuously  as  C2 
approaches  unity.  This  will  be  true  tor  any  value  of  Cl  except  Cl  = 
-1.  In  general,  one  must  expect  anomalous  behavior  when  noth 
conflicting  conclusions  are  certain,  but  there  seems  to  be  no  reason 
to  accept  discontinuities  in  noncontradictory  situations. 


Vision 

1 •  Introduction 

The  vision  modules  associated  with  the  pointing 
system  described  in  Section  11. C  were  designed  for  limited  and  well 
defined  purposes.  Our  long-term  objective  is  considerably  more 
ambitious:  the  construction  of  a  visual  information  gathering 

facility  that  may  be  called  on  by  other  subsystems  to  answer 
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questions  from  the  apprentice#  monitor  his  performance#  and  verify 
and  update  the  knowledge  base.  This  facility  win  consist  of  a  large 
number  of  general  and  special  puroose  vision  modules  coordinated  by  a 
problem  solving  executive.  This  executive  will  use  knowledae  of  the 
task  context#  of  the  perceptual  domain#  and  of  the  available 
perceptual  capabilities#  to  plan  effective  strategies  for  fulfilling 
Information  requests.  This  section  descrloes  two  major  research 
efforts#  one  on  perceptual  strategies,  the  other  on  scene 
understanding#  directed  towards  this  long  range  objective. 

The  techniques  required  for  fulfilling  information 
requests  may  range  from  a  simple  table  lookup  to  a  major  analysis  of 
the  entire  scene.  Certain  common  requests  may  be  handled  directly  by 
Passing  them  to  a  Packaged  module  such  as  a  tool  recognizer.  However# 
many  tasks  will  undoubtedly  require  planning  at  a  much  lower  level. 
Consider  a  question  such  as  "Is  the  flywheel  on  backwards."  It  so 
happens  that  the  flywheel  on  our  compressor  is  Painted  only  on  Its 
front  surface.  Knowing  this  tact#  the  particular  question  posed 
above  can  be  answered  relatively  easily  by  testing  color  at  the 
predicted  Image  location  of  the  flywheel,  (The  prediction  could  be 
based  on  the  same  compressor  model  used  for  pointing.)  Ubvlously  it 
Is  Impossible  to  provide  canned  strategies  of  this  type  for  all 
questions  the  apprentice  might  reasonably  ask. 

The  Issues  entailed  In  planning  perceptual  strategies 
are  fundamental  ones  that  arise  In  every  complex  Perceptual  domain 


reqdrdless  ot  the  particular  modules  involved.  first  the  available 
ootiohs  tor  accomrlishina  the  taste  must  he  assembled  in  a  Planninq 
draph,  second,  the  options  must  be  ornanlzed  into  a  plan  of  action 
based  on  relative  cost  and  likelihood  ot  achieving  desired  results. 
Thirds  the  Plan  must  be  monitored  during  execution  to  detect 
departures  from  initial  planning  assumptions  and,  if  necessary,  be 
revised.  For  several  years,  we  have  been  investiaatind  these  issues 
in  the  context  of  strategies  for  finding  objects  in  room  sicenes  t3  7, 
54}  . 

There  are  similarities  between  strategies  tor  object 
finding  and  those  tor  question  answering;  the  same  techniques  that 
select  features  for  dlstinguisnlnq  a  chair  from  other  room  objects 
can  be  used  for  distinquishlnq  the  front  and  back  of  a  pulley.  in 
the  next  subsection  we  describe  an  implemented  system  that  can  Plan 
cos t -e f t ect  1  ve  Inforniatlon  gathering  strategies  in  a  variety  of 
domains , 

The  second  area  ot  research  concerns  scene 
understanding,  fachlnery  is  one  of  the  most  difficult  scene  analysis 
domains.  Components  on  a  given  mecnanlcai  assembly  often  cannot  be 
distinguished  by  any  local  characteristics  except  their  detailed 
shape.  Moreover,  visual  character  1st Ics  may  .vary  widely  over  a 
generic  class  ot  components  performing  the  same  function  (e.g., 
carburetors).  Part  Identification  is  thus  likely  to  result  in 
ambiguities  when  the  parts  are  viewed  in  isolation.  Fortunately,  a 


245 


rlcn  set  ot  constraints  governs  relationship  ot  parts  to  each  other 
In  a  complete  assembly.  These  constraints  may  arise  from 
consideration  ot  the  tunction  or  operation  of  the  parts,  or  from 
methods  ot  fabrication  or  assembly.  For  example,  Corhuretors  are 
connected  to  the  intake  manifold,  a  foel  llne»  and  a  throttle 
linkage.  The  absence  ot  neighboring  carts  that  could  reasonably 
assume  these  interpretations  makes  it  unlikely  tnat  a  giver  part  is  a 
carburetor.  Our  goal  is  to  use  such  general  kno^^ledge  about  a  class 
of  eguipment,  (e.g.,  automobile  engines)  to  resolve  interpretation 
amblaultles  on  individual  parts,  eliminating  the  need  for  detailed 
structural  models  ot  specific  uni..s, 

A  framework  for  performing  this  type  of  reasoning 
about  scenes  was  described  in  last  year's  final  report.  Since  then, 
the  design  has  been  refined,  implemented,  and  tested  in  the  room 
scene  domain.  Hoorn  scenes  were  used  for  experimental  convenience  in 
testing  the  basic  reasoning  system  because  representations  for  both 
local  features  and  global  relations  were  already  available. 
Comparable  representations  are  currently  being  developed  for  the 
mechanical  eguipment  domain  with  local  interpretations  based 
primarily  on  3-u  shape  Inferred  from  range  data.  This  work  is 
reviewed  in  a  subsequent  subsection. 

2.  Scene  Analysis  Plan  Generation  and  Execution 

We  have  designed  and  implemented  a  planning  system 
that  makes  use  of  information  about  anticipated  costs  and 
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reliabilities  to  choose  the  best  course  of  action.  Altnougn  the 
Planner  was  rtesinned  ana  iJipienentea  as  a  core  subsystem  of  a  vision 
system  that  locates  oblects  in  office  scenes  137,  bb-b7J.  we  feel 
that  the  applicability  of  the  process  reaches  further  than  the 
boundaries  of  scene  analysis.  Therefore,  wnlle  me  examples  will 

mostly  be  chosen  from  problems  in  that  domain,  the  Presentation  win 
be  of  a  more  gereral  nature. 


ror  artificial  intelligence  proolem  solvers,  the  real 
problem  has  traditionally  been  to  generate  any  Plan  for  performing 
tne  desired  tasxi  since  the  cnolces  for  solving  the  proolem  were 
generally  limited,  the  choice  of  wnlch  subgoal  to  worx  on  and 
subsequent  execution  has  been  the  easy  part.  The  plannel  to  be 
described  nere  generates  a  (relatively)  complete  plan  for  me 
analysis  of  a  scene,  but  then,  more  Importantly,  organizes  tne  plan 
so  as  to  know  what  to  work  on  and  In  wnat  order.  The  problem  at  any 
point  In  execution  Is  to  know  what  to  do  next.  An  example  of  a  simple 
Plan  for  tlndlng  a  chair  Is  shown  In  Figure  4b.  we  will  mto 
detail  about  the  generation  of  this  plan  below. 


The  Planner  first  elaborates  the  goal  Into  the 
subgoals  required  tor  Its  solution.  These  subgoals  are  elaborated 
in  turn  until  no  m.ore  remain.  The  result  Is  an  AhP,-OH  planning  graph 
»Uh  tip  nodes  mat  are  executable  subgoals.  Next,  the  scorer 
organizes  the  graph  so  that  the  executor  can  find  the  best  terminal 
node  to  beoln  evaluating.  rne  plan  executor  executes  me  best 
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FIGURE  4B  DIAGRAM  OF  PLAN  FOR  FINDING  A  CHAIR 


subqoai  and  then  propagates  the  success  or  failure  of  the  goal 
through  the  original  plan,  in  order  to  select  subsequent  subaoals, 
Execution  continues  until  the  top  goal  either  succeeds  or  falls,  at 
Which  time  the  process  of  planning  and  execution  is  complete. 


Def  Initlons 


Before  describing  how  the  planner  works,  we  ' 

will  present  some  definitions  and  descriptions  of  strategies,  plans,  ^ 

and  elements  of  plans,  the  most  important  of  wnlch  is  the  goal  node.  ■ 

This  node  contains  information  about  the  satisfaction  of  the  goal,  ! 

ahd  also  contains  (Implicitly^  the  complete  structure  of  the  plan. 

3oai  -  a  representaticn  of  some  state  to  be  achieved,  A  goal  is  : 

either  directly  realizable  (l.e.,  executable),  or  is  an  intermediate 
goal.  Which  is  satisfied  oy  satisfying  its  subqoais.  An 
executable  goal  is  a  terminal  goal. 

The  format  of  a  goal  is  a  list,  •  .ie  first  element  of  which  is  usually[ 
the  activity  represented  by  the  goal  (e.g,,  FIND,  VALIDATE),  The  1- 
second  element  is  usually  the  object  for  which  the  goal  is  oeing  * 

executed.  Succeeding  elements  (if  any)  usually  contain 
information  Pertinent  to  the  goal.  For  example,  '• 
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(KlLTtH- VINDOW  DOOrt 


(LAMBDA  (X)  (LIMITP  X  (KUNCTlUN  HfcllLHT) 

2.5  5.0)) 

(LIMITF  X  (FUNCTION  SAT) 

.6  .75))) 

((HtlGHT  (6  .  8)) 

(SAT  (7  .  12)))) 

Is  a  typical  qoal.  The  activity  is  FlLrfc.R°nlM)Ow,  a  filtering 
proaram  that  passes  a  LISP  predicate  over  a  sampled  window#  of 
the  Image;  the  ooject  Is  OOOH;  the  next  element  Is  the  LISP 
predicate  to  be  used  In  filtering,  and  the  last  element  Is  the 
Internal  representation  of  that  predicate.  The  last  two  elements 
are  particular  to  FILiER-wiNDOw, 

Subgoal  List  -  a  list  of  subgoais  preceded  by  an  operator  from  the  sets 
And,  *AnD,  oh,  or  t.  The  operator  Indicates  how  solution  of  the 
subgoals  relates  to  solution  of  the  goal.  AND  and  #AnD  Imply  that 
all  the  subgoais  must  oe  achieved  to  satisfy  the  goal;  OR  Implies 
that  only  one  of  the  subgoais  must  be  satisfied.  A  «AND  requires 
that  the  subgoals  be  achieved  In  sequence,  t  Is  a  dummy  operator 
that  is  used  when  there  is  only  one  suogoal;  It  means  that 
satisfying  the  subgoal  Is  equivalent  to  satisfying  the  goal. 

This  operator  Is  used  primarily  to  minimize  the  complexity  of 
the  subgoal  lists.  Some  example  subgoal  lists  are; 


(AND  (FIND  St.AT)(FlND  BACK)), 

(#AND  (ACQlIlFt  DOQR)(GRUW  DUUH)),  and 

(OR  (ACQUIRF-Dl  RECT  PICTUHE)  (  ACOU  1  RL- 1  iviD  1 REC  T  PICTURE)), 

Ihe  first  example  is  the  suoqoal  list  for  (FIND  CHAIR); 
the  second  for  (BuUnD  DouR);  the  third  for  (AC(iUlKL  PIClURE), 

(or  goal  node)  is  a  list  consisting  of  tne  goal,  the  subgoal 
list  for  the  goal,  a  set  of  parameter  lists  for  scoring 
purposes,  and  the  parents  of  the  goal.  For  example, 

((AC(JUIRE  DOUR)  (OR  (  AC  QU 1  RE-0 1 REC  T  DOOR) 

( ACUUIHE-INDIRECT  DOOR)) 

((v'5)  (.95)  (,P55)  (50000.)  (585  00.)) 

((HOUND  DOUR))) 

could  be  the  goal  node  for  the  goal  (ACQUIRE  DOOR), 

the  set  of  goal  nodes  generated  for  satisfying  the 
Initial  goal,  in  li s  most  general  form,  the  plan  is  an  implicit 
AND-UR  graph.  Since  the  supgoals  point  to  one  another  through 
their  own  subgor.l  lists.  The  graph  structure  appears  when  a 
9oal  has  some  other  for  a  subgoal,  which  in  turn  has 
the  first  as  one  of  its  subgoals  (althouan  not  necessarily 
as  a  direct  descendant).  For  example,  as  shown  in  Figure  45, 
to  find  the  seat  of  a  chair  it  might  pe  Possible  to  first  find 
the  back  and  use  that  to  localize  the  seat.  However,  to  find 
the  back,  it  miqnt  also  be  possible  to  first  find  the  seat  and 
then  localize  the  back.  This  sort  of  reasoning  lads  to  plans 
with  loops. 


Module  -  a  module  Is  a  proorati  or  a  statement  describlnq  how  to  satisfy 

a  goal.  In  the  case  of  executable  goals,  the  module  Is  an  execution 
module  and  is  the  actual  program  to  be  executed.  For  nonterminal 
goals,  the  module  Is  a  planning  module  that  describes  hov-  the 
goal  Is  to  be  expanded  into  sub;oals.  A  module  may  have  various 
functions  associated  *rlth  it.  Some  common  ones  are  the  CGSTFN 
(Which  computes  the  cost  of  execution  of  the  module),  and 
the  PTFN  (Which  computes  the  probability  of  success).  In  addition, 
the  module  may  also  have  associated  functions  for  deciding  If  a 
previously  generated  goal  Is  equivalent,  or  related. 

Cost  -  In  the  context  of  planning,  the  cost  Is  the  anticipated  tlm.e 

that  would  be  spent  trying  to  satisfy  a  goal.  In  the  case  of 
bounded  processes,  such  as  filtering,  the  cost  can  be  estimated 
rather  closely.  For  less  bounded  processes,  such  as  region 
growth,  the  cost  is  approximated  from  Past  experience  and 
whatever  relevant  Information  may  be  available  (tor  example, 
the  expected  size  of  the  region  to  be  grown). 

Confidence  -  In  the  context  of  Planning  Is  the  probability  that  the 
execution  of  the  goal  will  have  a  good  outcome.  This  Is 
composed  of  two  Parts,  the  probability  that  the  outcome 
will  be  good,  given  that  the  node  succeeds,  and  the 
probability  of  success  of  the  goal.  Again,  In  cases  where 
the  process  is  well  modeled,  the  estimates  are  relatively 
good,  and  where  there  Is  no  good  model,  the  estimates 
are  based  largely  on  past  experience.  Confidence 
Is  always  between  1.0  and  0.0. 


Score  -  the  score  of  a  node  Is  the  value  of  a  function  that  computes 
a  cost  figure  normalized  by  confidence.  For  example^  cost 
divided  by  confidence  Is  the  measure  that  we  use  here; 
however,  other  functions  are  being  experimented  with, 

b.  Plan  Elaborator 

To  create  a  plan,  the  plan  elaborator  (PL'i 
expands  the  Initial  goal  (the  "top  goal",  which  Is  typically  to  find 

some  Object,  e.g.,  FIMD{  I’ABLf) )  into  the  subgoals  reguired  for  its 
solution.  The  subgoals  are  recursively  elaborated  In  exactly  the 
same  way.  if  the  Pt  cannot  generate  suoooa*s,  it  checks  to  see 
Whether  the  goal  is  directly  executable,  and  If  so  computes 
parameters  (cost  and  confidence)  for  later  use  in  scoring,  if  it  is 

not  directly  executable  and  has  no  subdoals,  the  elaborator  marks  it 
for  later  deletion. 

As  new  objects  are  noticed  by  tne  PE,  their 
names  are  added  to  an  "Instance  list".  This  list  Is  used  as  a  global 
"note-pad"  to  keeP  track  of  wnat  is  learned  about  the  objects  during 
execution  of  the  plan.  The  Initial  entries  into  the  Instance  list  are 
taken  from  a  globally  maintained  list  of  prototypes;  for  example, 
When  the  chair  seat  Is  noticed  for  the  first  time  In  the  course  of 
planning,  the  name  Is  looked  up  on  the  list  of  prototypes.  This  entry 
is  then  added  to  the  Instance  list.  The  prototype  contains  general 
Information  such  as  relations  between  tne  object  and  other  objects, 
cr  previous  plans  that  were  created.  This  Information  Is  available  to 


the  planner  durlnq  eldboration»  and  Is  also  used  by  modules  during 
execution  as  a  stor?.ge  medium  containing  up-to-date  Information  about 
previously  executea  modules.  For  example#  the  chair  seat  prototype 
could  contain  the  Information  that  tne  chair  seat  Is  belov  the  chair 
back.  During  execution  of  a  plan  to  find  the  chair  seat#  the 
acqulstlon  module  (discussed  below)  would  save  the  acquired  chair 
seat  samples  on  the  Instance  list#  which  would  then  be  available  to 
the  validation  module  for  further  processing. 

To  generate  the  suoqoals  of  a  goal#  the 
elaborator  checks  first  to  see  If  any  special  modules  exist  for 
satisfying  the  goal  for  that  particular  object.  This  allows  the  user 
to  provide  advice  to  the  Planner  about  certain  goals,  Kor  Instance# 
the  planner  could  be  Instructed  to  always  look  tor  the  telephone  on 
the  tabletop.  If  no  special  routines  are  available#  the  planner 
looks  for  routines  associated  with  tne  activity  and  that  are 
generally  useful  for  all  objects. 

For  example#  to  elaborate  the  goal  (ACQUiRt 
TABLt)#  the  planner  might  be  Instructed  to  use  a  horizontal  plane 
finder#  since  the  tabletop  is  a  horizontal  Plane,  Alternatively#  If 
there  was  no  Information  associated  with  TABLE#  the  elaborator  would 
look  into  general  purpose  routines  Pertinent  to  AC()UIRE,  Figure  45 
provides  another  example.  There  Is  a  module  for  FIND  that  says  to 
find  an  object#  find  Its  parts.  Therefore#  to  find  the  chair  a  Plan 
is  generated  for  finding  Its  major  parts#  the  seat  and  the  back. 


In  General,  several  planning  rrodules  may  be 
associated  with  a  given  activity,  in  order  to  select  the  expansion 
modules  appropriate  to  a  oartlcular  goal,  tne  Planner  evaluates  a 
predicate  function  associated  with  each.  if  tne  predicate  returns  a 
true  value,  the  planner  adds  the  module  to  Us  list  of  applicable 
modules.  Special  cases  of  the  predicate  function  can  cause  the 
module  always  to  be  selected  (to  provide  defaults)  or  can  cause  the 
module  to  be  selected  by  goals  specified  explicitly.  This  predicate 
allows  us  to  have  several  modules,  each  an  expert  In  a  relatively 
narrow  domain,  and  each  selectable  on  tne  basis  of  that  domain.  For 
example,  associated  with  the  activity,  ACQUlMt,  could  be  a  program 
for  locating  horizontal  planes.  This  program  would  then  have  a 
predicate  that  checked  that  the  object  was  horizontal. 

Before  a  newly  generated  goal  is  added  to  the 
list  of  goals  to  be  elaborated,  a  check  is  made  to  see  If  it  has 
already  been  generated,  or  it  any  equivalent  supgoals  have  been 
generated  (the  subgoal  must  have  a  special  function  to  allow  the 
Planner  to  decide  this).  in  either  event,  it  is  not  processed 
further,  and  the  subgoal  list  of  the  goal  being  expanded  Is  made  to 
point  to  the  previous  goal.  The  planner  win  also  check  tor  related 
subgoals  (that  can  succeed  or  fall  based  on  other  goals  that  are  not 
directly  related,  J.e.,  not  parents  or  children).  For  example,  the 
Planner  may  generate  a  strategy  that  Includes  multiple  filter 
subgoals  where  one  filter  predicate  subsumes  another.  It  the  less 
restrictive  predicate  falls  to  turn  up  the  desired  object,  it  Is 


guaranteed  that  the  more  restrictive  one  also  *'111  not 


Iherefore# 


if  the  less  restrictive  filter  is  selected  and  executed,  its  outcome 
CO  Id  imply  the  outcome  of  the  related,  restrictive  filter.  Tne 
Planner  maintains  an  explicit  list  of  related  subqoais,  tor  this  type 
of  situation. 


c.  Scorer 

After  a  plan  has  been  elaborated,  the  next 
step  is  to  decide  which  subaoal  to  attempt,  or,  in  general,  to  decloe 
What  to  do  next.  Obviously,  the  choice  depends  on  the  local  expen?.e 
of  executing  the  goal,  the  more  global  expense  due  to  the  fact  that 
4or.ie  goals  may  be  easier  after  other  goals  have  been  executed,  and 
also  the  resulting  likelihood  of  correct  results  after  the  goal  has 
been  executed. 


We  compute  a  score  for  a  node  which  allows  us 
to  make  a  selection  from  proposed  alternatives  for  satisfying  the 
goal.  This  score  function  win  be  cost  normalized  by  confidence,  with 
the  result  that  high  confidence»  low  cost  goals  win  have  a  smaller 
score  than  low  confidence,  high  cost  goals,  and  medium  confidence, 
medium  cost  goals  win  fall  somewhere  in  between. 

Before  discussing  the  tecnnlques  of  Scoring  a 
plan,  we  digress  briefly  for  a  preview  of  plan  execution.  The  plan 


executor  receives  a  completely  scored  plan.  It  starts  at  the  top  node 


ot  the  Plan  and  procee<iS  jo*ri*:irJ  throuar.  t.-ie  altar's  selertinj 

the  best  branch  (on  the  rasis  ot  scorej  until  it  reaches  a  terminal 
node,  ibis  exerutar  le  coal  i^  teen  evaluated.  It  tne  siit-ooal  tails> 
that  tailure  is  reqaroeit  as  arsoiote,  ard  tne  result  is  oropadated 
oacK'wards  throiiQh  ttie  L)la:i.  nn*ever»  it  tr.e  none  sucreejs#  then  t^e 

continence  ot  tne  none  is  tronaoatei  tacx.  fnat  is,  <,ii  nodes 

nependent  on  the  successtul  node  h^ve  tt.elr  inticioaten  contidence 

altered  to  reflect  the  success  ot  tne  loie.  -.ner  tt«  tropaiatlon 

ceases,  if  the  tor  anal  has  not  nean  sttisfia  i  t  ne  'jcuated  Plan  is 
rescored  and  execution  oroceeis  as  above. 


loe  output  of  tha  pi  at:  e  1  atu'r  at('r  Is  a 
Planninu  graph,  Inis  r enresehtat i on  ot  tne  strafenv,  aithoum 
usually  ronreentraht,  na,',  in  general,  nave  Incos.  .vhile  the 
Proolem  of  barkinq  costs  jrr|  confioetice  up  tnrouc  j  a  tree  str  icturp 
Is  quite  simple,  the  samp  prooletr  in  a  grapt:  Aiin  locos  is  not  gulte 
so  straight  tor*aro,  i-e  v  i  1 1  tirst  describe  rne  ternoinue  tor  a  tree, 
and  tnen  Sho'#  ho«  It  applies  to  a  orapn. 


ine  scorini  process  jses  <  relaxation 
tecnnlque#  All  noals  io  tf“  plan  are  pjt  on  a  list  tn  pe  examines. 
For  each  one  In  turn,  tne  score  is  cnr,butea  (it  t.ossiriej,  if  tne 
score  ot  a  node  changes  tm.  the  last  value,  its  -arents  are  nut  on 
tne  list  to  have  a  new  score  calculated,  1  le  orrjress  cdhtitmes 

i-tie  scores  stabilize,  it  a  moo  oas  ^  score,  it  medns  that 
some  way  (presumably)  exists  to  satisfy  tnat  m<i. 
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since  the  scores  tor  te^f^ln-^l  (executanle) 
nodes  do  not  change*  the  only  thing  *e  need  consider  tor  scorlna 
purposes  are  the  Interinediate  noaes,  we  oeqln  the  discussion  by 
considering  the  way  scores  are  bac<ed-up  from  a  subnode  to  Its 
immediate  predecessor. 

There  are  four  possible  types  of  intermediate 
nodes,  #ANL),  ANU,  UH,  and  t  .  The  t  node  merely  passes  its  score 
upwards  to  its  parents*  and  therefore  need  not  be  considered  further. 
Since  the  ♦AND  and  AND  nodes  require  all  the  subgoals  to  be 
satisfied,  a  score  for  this  type  of  node  can  only  be  computed  if 
scores  for  all  the  immediate  subgoals  have  been  computed.  However,  an 
UK  node  merely  requires  that  one  of  tne  subqoals  be  satisfied.  This 
means  that  even  it  only  one  of  the  suogoals  can  be  scored,  the  UK 
node  can  be  scored,  f.ttectlvely*  any  unscored  node  is  considered  to 
nave  a  score  of  infinity.  The  score  of  an  AM)  or  ♦and  node  with  an 
unscored  subqoal  is  also  Infinite,  unscored  subgoals  of  UK  nodes  can 
be  ignored,  and  tne  score  computed  on  tne  basis  of  the  ones  already 
Scored,  In  practice*  what  occurs  is  that  an  initial  score  is 
determined  for  some  surooals,  which  allows  other  subqoals  to  receive 
scores.  These  subqoals  in  turn  propagate  their  scores  back*  and  the 
process  continues  to  completion.  At  the  end  of  the  process,  any 
nodes  that  have  not  received  scores  are  deemed  impossible  to  satisfy* 
and  are  deleted  from  the  plan.  In  operation*  tne  actual  narameters 
that  are  backed  up  are  cost  and  confidence,  and  the  score  of  the  node 
is  computed  from  them  directly. 


we  will  use  the  symbol  S  to  stand  for 
score,  C  for  confidence,  and  k  tor  cost,  we  wm  aiso  use 
T  for  tne  successful  execution  of  a  node,  for  the  sequence 
of  successful  executions  of  nodes  i  tnrouqh  k,  T  for 
unsuccessful  execution  of  a  node,  and 


tor  the  sequence  of  unsuccessful  executions  of  nodes  1  throuqh  k. 
Thus,  s.  Is  the  score  of  the  Itn  node,  iq  the  anticipated 
cost,  and  q  the  confidence.  T.  is  the  representation  of 
successful  completion  of  node  1, 

The  confidence  Is  the  a  priori  orobabllitv  of 
a  "good  outcome"  from  the  node.  Ubvlousiy,  the  notion  of  a  good 
outcome  Is  directly  related  to  the  task  the  node  is  supposed  to 
satisfy.  For  example,  a  good  outcome  from  a  filtering  module  would  be 
that  It  discovered  a  few  points  on  the  target  oblect.  the  a  priori 
confidence  requires  that  the  node  succeed  for  a  good  outcome  to 
result,  and  is  therefore  the  joint  probability  of  a  good  outcome  and 
success  of  the  node.  we  make  the  standard  Bayes'  expansion  to 
represent  confidence  as  the  product  of  two  factors;  the  probabllty  of 
a  good  outcome  from  the  node,  given  the  success  ot  the  node,  and  the 
probability  of  success  of  the  node.  If  we  let  Yi  represent  a  good 
outcome  from  the  1th  node,  then  we  have 

Ci  =  P(Y^|t^)P(T.)  . 
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We  will  also  note  that  the  a  posteriori  probaollitv  of  a  qood  outconr.e 
from  a  node  is  zero  If  it  failed,  and 

P(YilTj^) 

If  It  succeeded. 

As  mentioned  above,  the  score  of  a  node  will 
be  the  cost  normalized  by  the  confidence,  that  Is 

S  =  K/C 

for  the  score  function.  In  the  coarse  of  searching  for  the  best  path 
through  the  graph,  we  win  attempt  to  minimize  this  function  at  each 
node.  In  order  to  compute  the  score  of  Intermediate  nodes,  we  win 
bacK-up  costs  and  confidences  from  subnodes  to  their  superiors,  we 
win  discuss  techniques  for  that  now, 

1)  Scoring  an  UF  Node 

We  begin  the  discussion  with  the  OH 
node  In  Figure  46.  We  assume  that  the  suonodes  are  ordered  by 
increasing  score.  The  backed-up  parameters  wm  be  dependent  on  the 
order,  and  It  can  be  shown  that  this  particular  ordering  will  result 
In  a  minimum  score  tor  the  node. 


Expanding  this  formula  gives 


We  have  In 


P(Y.,  T.,  t'-'S 

a  context  sensitive  measure  of  confidence.  That  ls»  It  1 

confidence  measure  that  takes  tne  past  history  of  the  parent 

Into  account.  As  this  will,  In  general,  oe  difficult  to  compute 

will  make  the  weakenlna  assumption  of  Independence  between  T, 

.  ,  1 
T,i-1 

^  ,  and  therefore 


T 


i-1 


We  also  assume  that  Is  dependent  only  on  ,  not  on 


T 


i-1 


With  this  assumption,  we  can  rewrite  the  formula  as. 


(U5) 


C 


OR 


-  y  C.  P(T^"^) 
i-1  ^ 


And  flraliy  we  have 


OR 


n  i-1 

=  y  c.  n  [1  -  p(T.)] 

i=i  j=i  ^ 


(06) 


The  expected  cost  of  the  node  Is  tti? 
sum  ot  the  expected  costs  of  each  of  the  Individual  subnodes,  wnlch 
Is  just  the  cost  of  the  node  times  the  probability  of  executlnq  It. 
The  probability  of  executing  a  node  Is  the  probability  that  all 
preceding  nodes  fall.  Therefore,  we  can  write  the  expected  cost  ot 
the  node  as 


n 


i-1 


K.  P(/'^) 


(07) 


With  the  same  assumptions  of  Independence  as  above,  we  can  write  the 
cost  formula  as 


n  i-1 

^OR  “  n  [1  -  P(T,)] 


(08) 


The  proDdbility  ot  success  of  the  OR 


node  is  just 


1  -  PCT*^)  , 


tnat  ls»  the  probabliltv  that  they  do  not  all  tall.  This  is  rewritten 


P(T  )  =  1-11 
“  1=1 


[1  -  P(T.)] 
1 


(uy  J 


The  score  is  computed  from  the 
backed-up  cost  and  confidence,  it  is  apparent,  however,  that  a  very 
expensive  subnode  with  low  reliability  would  pull  the  score  of  the 
whole  node  down,  even  though  it  might  be  likely  that  it  would  never 
oe  executed.  Since  we  would  like  the  score  of  a  node  to  reflect  the 
best  that  we  can  expect  from  the  node,  we  will  define  tne  score  to  oe 
the  minimum  score  ot  the  set  of  subsequences  ot  the  sequence  of 
subgoals.  That  is,  we  can  compute  the  score  tor  the  whole  sequence, 
then  to:  the  subsequence  without  the  last  goal,  then  without  tne  last 
two  subgoals,  and  so  on.  We  then  take  the  minimum  of  these  ..cores  to 
oe  tne  score  of  the  node.  But  this  definition  implies  that  the  score 
of  an  OH  node  will  always  tje  the  score  ot  the  first  subgoal  in  the 
sequence.  Therefore,  the  first  subgoal  in  the  sequence  win  represent 
the  node.  As  a  result,  the  planning  parameter’^  tor  the  node  become: 


It  Is  important  to  note  that  this  result  is  strictly  due  to  the 
choice  of  score  function.  The  more  general  results  will  be  required 
in  later  work  with  different  score  functions, 

llj  Scoring  an  and  Node 

ke  assume  that  the  subnodes  of  an  AND 

node  have  been  ordered  by 

K^/(l  - 

as  this  can  be  shown  to  result  in  a  minimum  score  tor  the  node,  A 
♦and  node  is  already  ordered,  so  the  formulas  derived  for  an  AND  node 
Will  apply  equally  to  a  *AND  node.  The  And  node  is  shown  in  Figure 


i=1 


1  N,  ) 


N,  ^  •  •  •  f  N_  i 


1  '"2  ) 

V  ■ 


(C,.P(T,|.  K,l  (C2,P(T2),  Kj)  (C„,P(V.  K^I  .7,  ' 


n  i-1 

K^Mn  =  S  K  TT  P(T  ) 

AND  ^  I  i 


^  <  2  ^  .  .  .  ^  _J1_ 

(l-C^I  (l-Cjl  (1-C^ 
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FIGURE  47  BACKED-UP  PLANNING  PARAMETERS  FOR  AND  AND  *AND  NODES 


The  confidence  in  this  case  is 
prohablllty  that  all  the  subgoals  rflli  have  a  good  outcome»  or 


With  our  assur^ptions  of  inde  endence»  v<e  have 


p(y"|t")  =  n  p(yJt.) 
i=l 


P(T  )  =  n  P(T.) 


Therefore , 


AND 


n  p(Y.  It.) 
1=1  ^  ^ 


II  P(T.) 
Li=l  ^ 


(012) 


or 


Cand  =  n  P(Y,  |tJ  p(TJ 
1=1 


1  1 


(01  J) 


And,  therefore, 


AND 


n 

=  n  c 


1=1 


(014) 


If  a  suDnode  of  an  AND  node  falls,  we 
terminate  execution.  Therefore,  the  expected  cost  of  a  single 
sunriode  in  the  sequence  is  the  cost  of  the  node  tlrres  the  propauinty 
of  executing  it.  This  propapliity  Is  the  probability  of  all  preceding 
nodes  succeeding.  The  cost,  therefore,  is 


n 


"and  “  ^  "i 
1-1 


(015) 
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The  probability  of  success  of  the 


node  Is 


"(Tand)  =  II  P(T.) 

i=l 


( 13 1  7  ) 


The  new  score  is  computed  from  these  backed-up  values. 


111)  Scoring  a  Plan 


with  these  techniques  for  computlna 
the  planning  parameters  of  Individual  nodes#  organizing  the  planning 
tree  becomes  a  straightforward  task,  Tne  parameters  of  the  terminal 
nodes  are  backed-up  to  their  predecessors.  These  Intermediate  nodes, 
In  turn,  pass  their  parameters  on  to  their  parents.  Finally,  the  top 
node  receives  a  score  and  the  process  is  complete,  ' 


However,  the  process  of  scoring  a 
plan  with  loops  (such  as  the  one  In  Figure  45)  Is  more  complicated. 


rne  program  tnat  scores  a  uian 
assutnes  that  the  Initial  score  of  a  nonterminal  node  Is  Infinite,  An 
AND  Cor  *AND  or  t  )  node  can  receive  a  nonlntlnlte  score  only  it  all 
of  Its  suoqoals  have  noninfinite  scores.  An  GF  node  can  receive  a 
nonlnflnlte  score  It  any  of  its  subqoals  has  a  nonlntlnlte  score. 
Therefore,  In  the  graph,  nodes  7  and  8  can  receive  initial  scores  of 


and 


K3/C 


3 


respectively.  Using  the  parameters  from  node  7,  node  6  can  be 
scored.  If  the  score  for  node  6  is  less  than 


K3/C3 , 


then  node  8  receives  a  new  score.  In  any  case,  node  5  can  also 
receive  a  score  since  node  8  now  has  one.  Again,  If  the  score  ot 
node  b  is  less  than  that  for  node  1,  then  node  7  receives  a  new 
score,  node  b  receives  a  new  score,  and  node  H  receives  a  new  score. 
It  is  Important  to  notice  that  It  the  score  of  node  b  Is  less  than 
that  tor  node  1,  and  this  is  reflected  oack  to  node  6,  It  is 
Impossible  for  the  new  score  of  node  6  to  be  less  than  that  for  node 


3 


If  It  were  less, 


it  would  mean  that  costs  around  the  loop 


decreased  and/or  contldence  Increased#  whicn  Is  not  Possible. 
Therefore,  either  the  final  score  of  node  5  will  be  greater  than  that 
of  node  1  or  the  tJ  lal  score  of  node  t>  will  be  greater  than  that  of 
node  3,  tie  also  see  that  there  will  be  a  maximum  of  two  iterations 
around  the  loop  before  things  settle  down. 

To  be  more  precise,  we  win  lerform 
tne  computations  with  sympolic  quantities  for  the  parameters  of 

terminal  nodes  1,  2,  3,  and  4,  the  initia  score  for  node  7, 

is 


From  this#  we  can  compute 


^6  ■ 


(L»18) 


and#  therefore# 


S  =  min 

O 


K./C  , 
3  3^ 


^1  ^ 
^1^4 


(Dl  >:>) 
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for  K  and  A  greater  than  u  and  C  and  B  oetween  0  and  1 


=  min 


K,/Ci, 


^3  ^3^2 

S^2 


Since  If 


*8  '  *^3/^ 


s 

s 


K.  + 

3  3  2 

C  C 
3  2 


The  final  result  is 


min  K  /c 


"1 


O  y 


S  y  =  min 


Ki/C^, 


3  2 


(1)25) 


^ow,  if 


K^/C 


1 


< 


tnen 


S 


7 


K^/C 


1 


and 


Sg  =  min 


K,  +  P  K, 
1  14 

K-/C  ,  - — - 

3  3 


(L»2b) 


What  this  means  is  that  the  first  node  to  execute  is  1,  but  the  next 


depends  on  the  relative  magnitudes  of 


and 


Ki  ^ 


C  C 
14 


d. 


Execution 


Alter  Plan  scoring  is  complete#  tne  execution 
program  selects  tne  best  executable  subqoal,  and  evaluates  It,  Tne 
success  or  failure  Is  propagated  upwards  to  all  parents#  and  anv 
related  subgoals  are  dealt  with  also.  It  tne  strategy  has  rot 
succeeded  or  failed  at  tnls  point,  the  planner  calls  the  scorer  to 
rescore  the  net  and  then  continues  with  the  next  goal. 


To  do  tnls,  the  executor  starts  at  the  top 
goal  Of  the  net,  and  proceeds  downwards  through  the  subgoals, 
wheiever  there  is  an  option.  It  chooses  tne  subgoal  with  the  lowest 
Score.  When  It  finds  a  node  where  the  oest  subgoal  Is  executable,  it 
passes  that  subgoal  to  an  evaluation  function.  This  function 
executes  the  subooal  and  propagates  the  success  or  failure  oacXwards, 
It  keeps  track  of  subgoais  that  were  executed,  along  with  their 
outcomes  on  a  special  list. 
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The  propagation  of  failure  ii. 
straightforward,  if  any  subgoal  of  an  Ai'«D  or  »Ai'iD  goal  tails#  then 
the  goal  itself  also  falls  and  continues  tne  propagation  upward.  a 
subqoal  of  an  UK  node  that  falls  is  rnerely  removen  fror.  the  list  of 
subqoals.  When  any  subgoal  list  is  reduced  to  a  single  subqoal#  the 
ooerator  is  repiacen  witn  tne  t  operator  whlcn  always  propaaates  tne 
outcome  of  the  subgoal  directly  upward. 

When  a  suogoal  succeeds#  its  a  priori 
confidence  value#  C#  is  replaced  by  the  a  posteriori 
confidence, 


C/P(T)  , 


that  is#  the  probability  of  a  qood  outcome  given  that  the  node 
succeedeq.  The  cost  is  set  to  zero#  and  p(T)  to  one.  This  allows 
the  parameters  of  the  predecessor  nodes  to  oe  adjusted  to  reflect  the 
success.  It  the  first  subqoal  of  an  AwD  node  succeeds#  then  the 
confidence  of  the  node  becomes 


n 

n 

i-i 


After  the  kth  node  succeeds#  the  confidence  is 


n  c.,  n  p(T.) 

•  1^-1  ^ 
1=1  1=1 


The  remaining  cost  after  success  of  the  icth  node  is 


n  i-1 

E  K.  ri  P(T.) 
i=k+l  ^  j=k+l  ^ 


Since  the  confidence  Is  incr  •  sJna,  and  the  cost  decreasing,  the 
score  of  the  node  decreases.  This  means  that  the  subgoals  of  the 
node  Will  be  executed  in  order  cis  long  as  they  are  successful.  The 
final  confidence  of  a  successful  AmD  node  is 


n  n 

n  c/ri  p(Tj 

i=l  ^  i=l  ^ 


If  a  subqoal  of  an  UF  node  succeeds,  then  tne  QH  node  Itself  succeeds 
with  a  posteriori  confidence. 


C/P(T) . 

This  is  propagated  back  alonu  with  the  cost  (which  is  ze.j)  and 
P(T)  (Which  is  one)  to  the  parents  of  tne  OR  node. 
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After  propagating  tne  outcore  ot  a  goal,  the 
executor  checks  the  list  of  related  goals  to  see  it  any  other  action 
needs  to  he  taken.  Since  in  nany  cases  tro  outcome  of  cnc  goal  can 
determine  tne  outcome  ot  another,  this  is  the  point  at  which  action 
Is  taken. 

If  the  outcome  of  a  subgool  does  not 
propagate  to  the  top  goal,  the  net  nas  a  new  score  computed  tor  it  in 
exactly  the  same  way  as  it  did  initially,  and  the  execution  continues 
with  the  next  goal.  It#  at  some  point,  a  graph  with  a  looo  is  left, 
and  there  are  no  terminal  nodes  that  wm  allow  for  a  solution,  then 
no  failure  will  propagate  to  the  top.  Instead,  tne  top  goal  will  not 
receive  a  score.  This  is  considered  a  failure  of  the  top  goal. 

e.  Conclusions 

We  have  described  an  artificial  intelligence 
Planning  and  execution  program  that  is  able  to  make  cost  effective 
decisions  about  what  to  do  next  in  analysing  scenes.  we  have 
described  in  some  detail  the  effects  of  a  particular  score  function 
(l.e.,  K/C  ,  This  is  probably  not  tne  best  possible  score 
function.  Another  possibility  that  wm  be  explored  is  to  treat  an 
OR  node  as  if  there  were  a  discrete  cost-continence  function 
associated  with  it.  That  is,  considering  each  subgoal,  there  is  a 
certain  relldblllty  to  be  expected  for  a  certain  cost,  we  can 
consider  these  cost  versus  reliability  values  as  points  on  a  curve, 


and  the  complete  set  provides  a  cost-conf ioence  function.  This 
function  can  then  oe  propaoated  uoward  instead  of  maklnq  a  oeclsion 
aoout  what  the  score  shoula  he  at  tne  local  node  level.  Inis  *d/, 
the  parameters  can  he  passed  up  to  the  executor  wnlch  can  tnen  necioe 
(uslnn  a  variety  of  criteria)  Just  what  should  be  oone.  With  this 
kind  of  Intormatioh  available,  the  executor  coum  use  budgetary 
considerations  (how  mucr,  resource  is  available  to  expend  tor  the  jot) 
or  considerations  about  required  reliability. 

A  cjyster  tor  Keasonlm  aoout  Scenes* 

a.  Introduction 

Tnls  section  describes  dSyS,  an  operational 
SYste-r  that  interprets  scenes.  Scene  interpretation  is  formulated  as 
a  constraint  optimization  problem.  Given  a  set  of  regions  from  a 
Partitioned  scene,  a  set  of  possible  Interpretations  for  each  region 
derlveu  from  local  surface  attributes  (e.g.,  color,  or i entat Ion j ,  and 
a  set  of  constraints  on  spatial  relationships  of  Interpretations, 
^SYS  deduces  the  most  probable  global  interoretation  for  each  region. 
Tne  systerr  nas  been  used  to  interoret  nanually  partitioned  room, 
scenes  usinu  a  variety  of  semantic  constraints. 


♦The  work  reported  In  this  section  was  partially 
supprrted  by  UNP  under  Contract  No,  Noo 1 4-7 1 -C-0294  [b8J 


Scene  Inter  pretdt  ion  been  previously 
approached  both  as  an  exercise  in  denuctive  reasonina  and  as  a 
problerr,  in  heuristic  obtirplzation.  As  a  reasonlia  exercise*  the 
Objective  vv^s  to  deduce  unique  local  Interor etat ions  tor  each  reqlori 
that  were  consistent  with  symbolic  qlooal  constraints  [59-61],  As  an 
optimization  problem*  the  objective  was  to  find  the  set  of  local 
Interpretations  with  the  highest  joint  ll<ellhood*  where  each 
Interpretation  llicellnood  was  a  function  ooth  of  the  local  realon 
attributes  and  the  ll.cellnoods  of  semantically  related 
Interpretations  assigned  to  other  regions  [62-61], 


The  most  successful  deductive  scene 
Interpretation  system  was  created  by  ^ialtz  161)  for  analyzing  Ideal 
line  drawings  of  scenes  containing  toy  nlocxs.  Lines  were  labeled  at 


each  Vertex  with  a  set  of  possible  Interpretations*  such  as  concave* 
convex*  shadow*  and  cracK.  Inese  Initial  Interpretations  were  based 
on  a  catalog  listing  the  various  ways  legal  vertices  of  trlheiral 
solids  could  appear  In  a  line  drawing.  Some  line  Interpretations 
coulo  be  Immediately  rejected  as  Impossible  If  they  were  not  assigned 
at  both  ends  of  the  line,  tllmlnatlng  a  line  Interpretation  would 
eliminate  one  cr  more  possible  Interpretations  for  eacn  of  its 
vertices*  which  In  turn*  could  eliminate  additional  Interpretations 
of  other  lines  joining  at  those  vertices.  This  elimination  process 
would  often  propagate  until  each  line  was  left  with  a  unique 
Interpretation . 


h‘*  V.’-  .  " 
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me  deductive  approacn  to  scene  analysis  is 
limited  to  symbolic  problem  domains  such  as  line  drawing  analysis,  in 
Which  all  Interpretations  that  violate  constraints  are  dismissed 
absolutely  and  all  those  tnat  do  not  are  considered  equally  likely. 
Most  real  Perception  problems,  ty  contrast,  entail  noisy  measurements 
and  probabilistic  constraints.  ibus.  It  is  not  meaningful  to 
speak  of  correct  or  incorrect  interpretations,  out  only  of  the  most 
probable  interpretations,  given  current  evioence.  A  number  of 
investigators  have  therefore  chosen  to  view  scene  1 nt eroretat ion  as  a 
heuristic  optimization  problem. 

In  seen?  interpretation,  the  likelihood  of 
each  region  interpretation  theoretically  depends,  at  least 
indirectly,  on  the  likelihood  of  every  other  region  interpretation. 
Because  of  this  interaction,  the  searen  space  explodes  exponentially 
With  both  the  number  of  regions  and  the  universe  of  Possipie 
interpretations.  Numerous  simplifying  assumptions  have  been  proposed 
to  make  the  search  tractable.  Both  Duda  [59J  and  Guzman  160] 
performed  a  limited  tree  search  using  local  binary  valued  constraints 
on  legal  adjacency;  interpretations  were  assigned  to  regions  in  order 
Of  maximum  local  likelihood,  suoject  to  semantic  consistency  with 
interpretations  previously  selected  for  adjacent  regions.  Eiimlnatinn 
all  possible  interpretations  for  an  unasslgned  region  forced 
reconsideration  of  an  earlier  assignment.  Yaxlinovsky  developed  two 
algorithms  which,  while  still  based  on  tree  search,  utilized  wider 
Classes  of  constraints  I63j .  Algorithm  A  allowed  real  valued 


bounriary  constraints  wnlcfi  could  alter  the  local  likelihood  of  an 


Interpretation  based  on  the  attributes  and  interoretation  likelihoods 
of  adjacent  reqlons.  These  constraints  were  used  tollowim  an 
instantiation  to  update  the  Interpretation  likelihoods  of 
uninstantiated  ic'lons  Immediately  adjacent  to  the  newly  Instantiated 
one.  A  branch  and  bound  condition  on  the  product  ot  all  instantiated 
Interpretations  was  used  to  terminate  search  alono  umpromisinq  lines. 
Algorithm  B  allowed  real  valued  constraints  between  arbitrary  pairs 
of  region  Interpretations.  Tnese  constraints  were  again  used  only  to 
update  Interpretation  likelihoods  of  uninstantiated  regions#  that 
were  directly  related  to  a  newly  Instantiated  interpretation.  The 
use  of  real  valued  constraints  provided  Yakimovsky  with  a  more 
sensitive  measure  of  global  likelihood  for  assigning  Interpretations 
to  regions.  However,  since  both  his  algorithms  limited  constraint 
Interaction  (by  freezing  the  likelihoods  of  Instantiated 
Interpretations)  In  the  Interests  ot  search  efficiency#  the  resulting 
likelihoods  represent  only  an  approximate  simultaneous  solution  ot 
the  constraints. 


Besides  obtaining  only  approximate  solutions# 
all  of  the  above  methods  share  another  inherent  fault;  hard  won 
Information  Is  frequently  thrown  away  when  the  search  backtracks.  In 
one  of  Du da's  examples #  a  particular  region  Is  deduced  not  to  be  an 
electrical  outlet  on  at  least  five  separate  branches  of  the 
Interpretation  tree.  In  each  context#  outlet  was  exclud'^d  as  a 
possible  Interpretation  because  the  region  in  question  was  adjacent 
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to  a  region  tnat  had  already  been  postulated  to  oe  the  floor,  it  vas 
precisely  this  type  of  redundant  reasoning  tnat  ^-altz  sought  to 
avoid,  by  ellminatlnq  Inconsistent  interpretation  before  embarking  on 
search.  It  occurred  to  us  that  a  similar  deductive  scheme  might  he 
used  with  real  valued  constraints  to  depress  the  likelihood  of 
inconsistent  interpretations.  An  Interpretation  witn  low  enough 
likelihood  would  effectively  be  eliminated  because  it  would  never  h® 
selected  for  instantiation.  The  consequent  reduction  in  wasted  search 
effort  could  then  ue  redirected  toward  a  more  optimal  mobai 
determination  of  interpretation  likelihoods. 


The  following  section  describes  a  realization 


of  these  objectives. 


M*  -  An  Optimization  Algorithm  Usina 
Constraint  Propagation 


This  section  outlines  an  algorithm  for  scene 
interpretation  that  combines  the  best  features  of  deduction  and 
optimization  158],  tjach  region  in  a  partitioned  scene  is  assigned  all 
interpretations  permitted  by  its  local  attributes  (p,q,,  it  may  be 
door  01.  wall  on  the  basis  of  color,  slz^,  and  surface  orientation),  A 
likelihood  is  associated  with  each  Interpretation,  -based  Initially  on 
the  a  priori  likelihoods  of  alternative  Interpretations  tor  the 
region.  These  local  likelihoods  are  then  reevaluated  based  on  the 
current  likelihoods  of  all  semantically  related  interpretation--,.  This 
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simultaneous  reevaluation  is  accomplished  on  a  serial  computer  by  a 


relaxation  process  that  culminates  with  a  set  of  dlobal  equl I iorlum 


likelihoods.  This  relaxation  process  Is  the  analoq  of  ^-altz's 


deduction  process  tor  real  valued  constraints  and,  like  that  process. 


can  be  Implernentea  using  a  propagation  tecnnlque,  as  win  be 


discussed  In  Subsection  c  below. 


The  resulting  eautlibrlum  likelihoods 


represent  estimates  of  the  global  validity  of  alternative 


Interpretations  In  the  current  context.  It  all  regions  are  left  with 


a  single  probable  interpretation,  the  analysis  terminates 


successfully. 


Un  the  other  hand.  If  all  interpretations  of  any 


regions  are  judged  unlikely,  the  analysis  Is  abandoned  on  grounds 


that  the  context  is  inconsistent.  The  most  usual  case  finds  at  least 


0 -.e  region  still  left  with  several  possible  Interpretations, 


analysis  then  reverts  to  a  searcn  for  the  set  of  region 


interpretations  having  the  highest  joint  likelihood. 


The  search  proceeds  at  each  step  by  restoring 


the  highest  scoring  context  (initially  the  global  context)  and 


instantiating  the  most  likely  ambiguous  interpretation  remaining  In 


that  context.  Equilibrium  likelihoods  are  recomputed,  based  on  the 


new  Instantiation,  and  used,  as  in  the  global  context,  to  decide  the 


future  course  of  the  search.  If  all  regions  now  have  unique 


Interpretations,  the  search  Is  terminated#  It  any  region  has  no 


possibie  interpretations,  the  context  is  abandoned#  otherwise#  a 
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global  score  for  tne  context  Is  computed  oy  summlnq  the  equilibrium 
likelihoods  of  the  currently  best  Interpretation  for  each  reoion.  The 
Search  then  continues  In  the  currently  best  context. 


In  Kef.  58  It  is  proved  that  this  alaorlthm, 
^Ith  reasonable  restrictions  on  the  nature  of  the  constraints,  win 
terminate  with  the  optimal  set  of  interpretations  for  those 
constraints.  The  resulting  equllibriun.  likelihoods  will.  In  general, 
be  better  estimates  of  actual  global  likelihoods  than  tnose  obtained 
by  the  methods  described  in  Subsection  a  above.  Moreover,  it  Is  shown 
that,  in  finding  the  optimum,  tnls  new  Search  wni  instantiate  no 
more  interpretations  than  any  of  tne  conventional  tree  searchino 
methods.  The  Improved  estimates  of  interpretation  likelihood  provided 
by  the  global  relaxation  process  improve  the  order  ot  instantiation 
and  context  selection  at  each  stage  of  search,  thereby  minlTiziha 
backtracking.  The  reiaxatloh  process  can  thus  ne  considered  a  new 
type  of  glooal  lookahead  embedded  in  a  conventlcnal  best  first  search 
algorithm.  All  of  the  aloorlthms  discussed  in  Subsection  a  are  in 
fact  special  cases  of  our  algorithm  utiiizinn  limited  propagation 
and/or  constraints  158J. 


The  number  ot  instantiations  Is,  of  course, 
only  one  measure  of  search  efficiency.  ine  computational  effort 
expended  in  lookahead  must  also  oe  considered  in  assessing  which  of 
two  optimization  approaches  is  more  efficient  overall.  The 
relaxation  procedure  is,  admittedly,  a  computationally  expensive  form 
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of  lookaneadf  but  it  can  be  very  cost-effective  In  problem  domains 
with  large  numbers  of  hyootheses  Interacting  tnrougn  many  oalr^ise 
constraints.  This  cost-effectiveness  stems  from  the  fact  that  many 
Inconsistencies  are  deduced  once  and  for  all  In  the  alobai  context 
rather  than  havlno  to  be  repeatedly  rediscovered  tor  Individual 
Instantiations  as  In  conventional  bacKtrack  searches. 

c,  MSYS  -  An  Implementation  of  M-* 

Implementation  of  the  M*  optimization 
algorithm  described  above  requires  a  relaxation  mechanism  for 
constraint  evaluation  and  a  context  s*fltchlnq  mechanism  for  searcn. 

We  will  describe  generalized  Implementations  for  these  two 
components^  which  are  designed  to  facilitate  experimentation  with  a 
Variety  of  knowledge  representations,  search  strategies,  and  control 
structures  (Including  specifically  all  strategies  mentioned  In 
Subsection  a) , 

1)  Constraint  tval uat lon--The  XDEMON 
System 

The  simultaneous  determination  of 
equilibrium  likelihoods  tor  a  mutually  constrained  set  of 
Interpretations,  Inherently  a  parallel  operation,  has  been 

♦A  detailed  Implementation  of  MSYS  using  these  components  appears 
In  Ref,  58, 


efficiently  implemented  on  a  serial  computer  by  slmulatinq  a  network 
of  asynchronoui,  parallel  processes  interactlnq  through  a  qlooal  data 
base.  The  data  base  consists  of  variables  representing  constrained 
entitles  and  constraints.  Associated  with  each  variable  is  a 

procedure  for  computing  a  value  in  terms  of  the  current  values  of 
other  variables,  fcach  variable  also  has  a  list  of  related  variables 
Whose  procedures  utilize  the  present  variable  as  Input.  When  the 
cumulative  change  in  the  value  of  a  variable  exceeds  a  threshold,  its 
related  variables  are  activated  by  adding  their  procedures  to  a  stack 
Of  jobs  to  be  run.  Thus,  it  running  a  process  chances  the  value  of 
its  associated  variable.  additional  processes  may  be  activated. 
Execution  terminates  when  the  job  stac>c  is  empty. 

The  evaluation  process  is  initiated 
by  loading  the  job  stack  with  the  procedures  of  variables  for  which 
updated  global  likelihoods  are  desired.  Initially,  the  procedures 
Of  every  variable  are  put  on  the  job  stack  to  obtain  global 
equilibrium  likelihoods.  The  consequences  of  subsequent 
Instantiations  are  explored  by  queueing  only  the  orocedures  of 

variables  directly  dependent  on  tne  values  of  the  instantiated 
variables  . 

The  above  scheme  -  for  esta'^i  i shina 
global  likelihoods  is  applicable  to  a  variety  of  constraint 
satisfaction  and  optimization  problems.  A  set  of  LISP  functions, 
known  collectively  as  the  system  XUtmON,  pas  been  developed  to 


facilitate  the  creation  of  network  representations  for  particular 
constraint  problems.  These  functions  vere  documented  in  Appendix  b 
Of  Kef.  37.  tor  our  scene  interpretation  application,  variables  are 
used  to  represent  regions,  region  interpretations,  and  relational 
constraints  between  pairs  of  regions  (e.a.,  adjacent,  above,  and  the 
like).  Keglon  variables  evaluate  to  boundary  descriptions, 
interpretation  variables  evaluate  to  the  current  global  likelihood  of 
tnat  interpretation,  and  constraint  variables  evaluate  to  the  degree 
to  Which  argument  regions  conform  to  the  stipulated  constraint. 

The  procedure  associated  with  each 
interpretation  variable  computes  current  likelihood  as  a  function  ol 
local  likelihood  (l.e.,  a  likelihood  based  solely  on  a  region's  own 
attributes)  and  global  likelihood  (l.e.,  a  likelihood  based  on  the 
current  likelihoods  of  semantically  related  interpretations  and  on 
the  values  ot  corresponding  constraint  variables  expressing  how  well 
each  relation  is  satisfied).  The  variables  are  interconnected  so  that 
the  reevaluatlon  of  any  region  variable  (reflecting  a  cnange  in 
boundary)  will  cause  all  contextual  constraints  involving  that  region 
to  be  reevaluoted,  iilmliariy  the  reevaluatlon  of  any  interpretation 
or  constraint  variables  will  automatically  gueue  all  semantically 
related  Interoretatlons  for  reexamination.  The  efficiency  ot  the 
scheme  stems  from  the  tact  that  variables  are  only  •  reevaluated  when 
the  value  of  a  contextually  related  variable  changes. 
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A  simple  state  savlna  mechanism  has 


been  programmed  that  allows  a  current  computational  context  to  he 
reinstated  at  a  future  time.  The  search  context  for  consists  ot 
the  complete  network  ot  variables  described  in  Subsection  b  above 
Plus  additional  problem  dependent  varlaoies  that  typically  may 
Include  a  global  score,  a  list  ot  previous  region  instantiations ,  and 
a  priority  queue  (called  IQUL'UE)  ot  Instantiations  yet  to  be  tried  in 
that  context.  Ihe  saved  context  is  Inserted  onto  a  priority  queue  ot 
contexts  (SOUf.Uk)  to  be  explored.  in  general,  a  search  proceeds  by 
reinstating  the  top  priority  context  on  SQUtUt:,  selecting  the  best 
instantiation  from  the  current  igutUF,  and  then  reevaluating  the 
network  of  variables  in  tne  new  context  created  by  that 
instantiation.  An  acceptable  solution  terminates  the  search. 
Otherwise,  IQUE.UE  is  updated  and  the  new  context  added  to  SQDEUt,  The 
search  then  continues  in  the  top  context. 

The  nature  ct  the  search  win  be 
determined  oy  the  problem  dependent  priority  functions  used  to  update 

SQUEUe  and  IQUEUE  and  oy  the  termination  condition.  A  depth  first 
search  is  obtained  by  always  adding  new  contexts  to  the  toP  of 
SOUEUE,  a  breadth  first  search  is  nad  by  always  adding  them  to  tne 
bottom,  and  a  best  first  search  is  realized  by  queueing  contexts  in 
order  of  global  score  165J .  Heuristic  guidance  is  Introduced  into 
the  search  by  the  function  that  updates  IQUEUE.  The  termination 


condition  can  oe  chosen  to  select  the  t)lqhest  scorlno  solution  tl.e., 
a  complete  set  ot  globally  consistent  Instantiations),  the  tlrst 
solution  encountered,  or  a  complete  enumeration  of  all  solutions. 

d.  Using  MSYS 

An  interpretation  problem  Is  posed  to  MSYS  in 
the  following  way.  First,  the  experimenter,  using  a  trackball, 
circles  a  set  of  test  recions  on  the  oisDlayei  Image  of  a  scene,  as 
Indicated  in  Figure  49,  These  regions  are  retalneo  on  a  oisk  file. 
Next  he  enters  the  constraints  to  oe  used  in  the  current  experiment, 
rie  ma’  also  directly  assert  sympolic  relationships  between  regions 
(e,g,,  that  two  regions  ne  considered  adjacent).  This  ability  was 
useful  tor  simulating  unlmpiemented  relational  procedures  and  for 
fabricating  experimental  situations.  Interpretation  Is  Initiated  by 
calling  the  function  interpret  with  a  region  file  name  or  a  list  of 
regions  as  an  argument,  MSYS  responds  with  a  complete  protocol  ot 
the  Interpretation  process  containing,  tlrst,  a  list  of  locally 
possible  region  Interpretations  and  their  Initial  likelihoods, 
second,  a  trace  of  all  jobs  executed  trom  the  job  list  and,  third,  a 
final  list  ot  unique  region  Interpretations  with  associated 
likelihoods  (or  else  a  message  announcing  failure  to  find  consistent 
Interpretations), 

Constraints  are  entered  In  the  format 
(ADDCONST  Pel  Vllst),  Rel  is  a  simple  relation  such  as  (Above 
Chalrback  Chalrseat),  a  boolean  expression  of  simple  relations  such 
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FIGURE  49 


MANUALLv  PARTITIONED  ROOM  SCENE  WITH  LOCAL  BAYESIAN 
INTERPRETATION  LIKELIHOODS  BASED  ON  HEIGHT  AND  SURFACE 
ORIENTATION 


(Or  (Adjacent  Picture  Wall)  (Adjacent  Picture  Krame)),  or  a 
functional  constraint  sucn  as  (Homogeneous  Door),  Independent 
constraints  on  the  same  interoretatlon  are  assumed  to  be  embedded  in 
an  Implicit  conjunction,  Vilst  Is  a  list  of  the  Interpretations  to 
which  a  constraint  applies.  Thus  (ADOCOi^lST  (Adjacent  Picture  wall)) 
(Picture))  requires  all  pictures  to  be  adjacent  to  Walls  but  puts  no 
constraint  on  Walls,  If  Vlist  is  omJtted»  MSYS  assumes  that  the 
constraint  applies  reciprocally  to  an  Interpretations  mentioned 
within  It. 

e.  An  Exan.ple 

The  operation  of  mSyS  win  be  Illustrated  by 
describing  ar.  Interpretation  of  the  scene  partition  shown  In  Figure 
49r  using  the  constraints  given  In  Figure  50,  These  particular 
Constraints  were  empirically  selected  for  this  room  scene  domain  on 
the  basis  of  their  computational  simplicity  and  their  suitability  for 
use  In  partially  partitioned  scenes.  Alternative  constraints  come 

[ADDCONST  (QUOTE  (NOT*  (AOJ  DOOR  PICTURE] 

(AOOCONST  (QUOTE  (FUNCTION  ROOMPART)) 

(QUOTE  (ODOR  WALL))} 

(ADDC0N6T  (QUOTE  (FUNCTION  HOMO)) 

(QUOTE  DOOR)) 

(ADDCUNST  (QUOTE  (FUNCTION  HOMO)) 

(QUOTE  WALL)) 

(ADDCUNST  (QUOTE  (FUNCTION  HOMO)) 

(QUOTE  CBACK)) 

FIGURE  50  CONSTRAINTS  FOR  ROOM  SCENE  INTERPRETATION 


readily  to  mind:  (ADJACtNT  PICTURE  WALL)  anu  (NUT  (ABOVE  DuUR 
WALD),  to  name  two.  No  formal  basis  yet  exists  tor  chooslnq 
Particular  constialnts. 


The  first  step  in  analysis  is  the  asslqnment 
of  possible  Interpretations  to  the  regions  based  on  their  local 
attributes,  {•Igure  51  shows  the  interpretation  variables  created 
during  this  initial  ’abeJlng  phase  and  their  associat*»d  local 
likelihoods.  These  local  interpretations  were  obtained  using  a 
Bayesian  classifier,  which  compared  the  height  and  surface 
orientation  of  regions  in  Figure  49  with  those  rt  training  regions 
previously  outlined  in  a  similar  scene,*  For  each  region  only  those 

with  a  likelihood  exceeding  ten  percent  of  the 
likelihood  of  the  most  probable  interpretation  were  retained.  Initial 
classification  was  based  on  height  and  orientation,  because  th^se 
were  considered  more  intrinsic  attributes  than  color  and  brightness. 
The  homogeneity  of  color  and  brightness  over  a  given  surface, 
however,  provided  a  key  global  constraint.  Note  that  each  horizontal 
surface  received  a  unique  interpretation  determined  by  its  height, 
but  that  all  vertical  surfaces  received  at  least  two  possible 


•Height  and  orientation  are  obtained  directly  from  range  data  using 
transformations  desc/lbed  in  Ref,  66,  The  data  used  in  our 
experiments  simulated  the  output  of  a  developmental  time  of  flight 
laser  range  finder  [37],  whose  current  accuracy  is  about  one  inch  in 
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FIGURE  51  INITIAL  EQUILIBRIUM  LIKELIHOODS  BEFORE  SEARCH 
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Interpretations  (door,  rfall,  and  when  consistent  with  helqnt 
extremes,  wastebasket,  chalrbacK,  or  picture).  Global  cohstralnts 
were  thus  only  needed  for  vertical  surfaces.  The  Ha/eslan 
likelihoods  associated  with  the  Inter or etat loos  of  vertical  regions 
represent  the  expected  proportion  of  the  ima je  occupied  by  each 
Interpretation.  The  likelihoods  assigned  to  (wall  Or)  and  (Door  Dr) 
In  Figure  51,  for  example,  reoresent  the  relative  areas  occupied  by 
Wall  and  Door  In  the  test  Imaoe. 

The  second  step  of  analysis  entails  the 
construction  ot  evaluation  tunctlons  for  each  interpretation  varlahle 
anrt  the  suosequent  computation  ot  qlooal  equlllorluT  llKellhoods.  The 
state  Of  the  data  base  tolloelnq  the  attainment  of  equilibrium  is 

sho.n  in  Figure  52.  (For  conciseness,  the  unlguelv  Interpreted 
horizontal  regions  have  been  oMltted.) 

The  evaluation  function  for  each 
interpretation  is  formulated  as  a  conjunction  of  local  IKellhood 
(see  figure  52)  and  support  for  aopilcdoie  constraints.  The  supoort 
for  each  constraint  is  expressed  as  a  logical  combination  of  other 
interpretation  likelihoods  and  region  relations.  Indicating  all  the 
possible  ways  that  the  constraint  can  be  satisfied  In  the  current 
image.  The  actual  process  of  creating  these  evaluation  functions  Is 
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fhe  constraint  (Homogeneous  ‘vali),  requires 
that  ail  regions  Interpreted  as  wan  pave  similar  brigntness.  This 
constraint  Introduces  a  clause  of  the  form  (nuT*  (uh*  (wall 
Kll)---(Wail  Rin)))  Into  the  lliceiinood  funclion  of  each  wall 
Interpretation  (Wall  HI).  The  disjunction  Includes  all  regions 
admitting  the  Interpretation  wall,  wnose  nrigntness  differs  from  that 
of  HI  by  more  than  ten  percent.  The  effect  Is  to  reduce  the 
likelihood  that  region  Hi  is  wall  by  an  amount  probortionai  to  tne 
likelihood  that  these  other,  nonhomogeneous  regions  are  thought  to  oe 
wall.  Homogeneity  constraints  on  other  interpretations  nave  analogous 
effects , 

Ihe  Constraint,  Poompartltlon,  requires  that 
the  brightness  of  all  regions  admitting  the  Interpretations  wall  or 
Door  (l.e.,  surfaces  that  partition  rooms)  be  similar  to  that  found 
at  the  very  top  of  the  image  vertically  above  their  centers  of 
gravity.  Region  Interpretations  falling  this  test  are  rejected 
outright  by  pinning  their  likelihood  to  zero.  The  likelihood  of 
Interpretations  that  pass  Is  unaffected.  The  Poompartltlon 
constraint  is  closely  related  to  trie  previously  discussed 
homogenerlty  constraint  and  was  Included  to  handle  cases  where  that 
constraint  was  Ineffectual  because  tne  experimenter  failed  to  circle 
enough  regions,  it  Is  based  on  an  assumption  that.  In  a  standard 
view  of  a  room  scene,  wall  or  door  win  appear  at  the  top  of  the 
Image,  and  moreover,  that  walls  and  doors  never  appear  vertically 
above  each  other.  The  effect  of  this  constraint  was  to  eliminate 


’Door"  and  "Waii"  as  oossioie  Interpretations  of  vertically  oriented 
regions  lacking  appropriate  vertical  extent.  Specifically  "Door"  and 
"i^fail"  Were  eliminated  as  possible  Interpretations  of  the  regions 
Chalrbackf  Plc»  and  we>Ski»  leaving  those  regions  with  onlgue 
Interpretations  . 


The  relational  constraint,  (NOT*  (Adjacent 
Picture  Door)),  Is  self-explanatory.  It  Introduces  a  clause 
reducing  the  likelihood  that  a  region  Is  a  Picture  ty  an  amount 
proportional  to  the  likelihood  that  adjacent  regions  are  thought  to 
be  Doors,  A  loose  definition  of  adjacency  nas  been  adopted  In  order 
to  utilize  this  constraint  in  a  Partially  segmented  scene:  two 
regions  are  adjacent  If  the  line  connecting  their  centers  does  not 
pass  through  a  third  region. 

The  Numerical  equilibrium  likelihoods  shown 
In  Figure  52  were  obtained  by  executing  the  evaluation  functions  as 
if  they  were  Bayesian  combinations  of  Independent  probabilities 
(l.e.,  a  conjunction  of  likelihood  values  evaluates  to  the  proauct  of 
those  llkelihods,  the  negation  of  a  likelihood  to  one  minus  the 
likelihood,  and  a  disjunction  of  likelihoods  to  one  minus  a  product 
of  the  negations  of  the  likelihoods).  More  sophisticated 
quantification  Schemes  are  given  In  Ret.  5«, 

The  final  stage  of  analysis  entailed 


searching  for  a  set  of  unique  Interpretations  that  were  globally 


consistent.  The  only  amblaulty  remainlnq  In  tne  global  equilibrium 
context  Involved  the  regions  Dr,  l.waii,  and  RWali,  aU  of  which  still 
admitted  both  door  and  wall  as  possible  Interpretations,  Homogeneity 
constraints  forced  LlNall  and  HWall.  both  light  colored  regions,  to 
take  the  same  Interp.-etatlon  (either  ivall  or  Door)  end  Dr,  a  dark 
colored  region,  to  take  tne  opposite  interpretation.  This  basic 
ambiguity  was  resolved  during  the  course  of  searching  by  the 
adjacency  constraint  on  pictures,  which  led  to  a  contradiction  when 
either  LWall  or  HWall  was  Instc-ntiated  to  Door. 

The  search  preceded  without  any  backup 
because  the  correct  Interpretation  of  each  region  already  had  higher 
likelihood  than  any  alternative  Interpretations  In  the  Initial  global 
context  (Figure  52).  The  relative  likelihoods  of  these  correct 
Ihterpretat iohs  Increased  monotohlcaiiy  with  each  successive  correct 
Instantiation.  The  final  Interpretations  for  the  regions  In  Figure 
49  are  presented  in  Fig  re  53,  A  detailed  trace  of  the  reasoning, 
showing  all  instantiations  and  resulting  ree valuat Ions ,  appears  In 
Ref.  58, 

f.  Conclusions 

A  working  Implementation  of  a  new  seen? 
Interpretation  technique  has  been  demonstrated.  So  far,  the 
experimental  results  are  Inconclusive  because  of  Ihe  simplicity  of 
the  test  scene  and  the  reliance  on  simulated  range  data  for  assigning 
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Initial  Interpretations.  The  experli\ent  win  be  repeated  shortly 
using  the  actual  laser  range  tinder.  Expectations  are  that  the  data 
will  provide  height  estimates  accurate  to  a  few  Incnes  but  that  it 
Will  be  to.'/  noisy  to  yield  usaole  measures  of  local  orientation. 
Consequently,  additional  constraints  win  be  needed  to  distinguish 
horizontal  and  vertical  surfaces  at  the  same  height,  such  as  tabletop 
and  wall.  It  would  also  be  Interesting  to  see  how  far  one  could  get 
without  direct  range  data  by  Inferlng  height  and  orientation  entirely 
from  pictorial  clues  such  as  Image,  height,  and  shadows. 

Scene  Interpretation  typifies  a  class  of 
problem  solving  tasks  involving  large  numbers  of  globally  interacting 
constraints.  A  general  constraint  optimization  algorithm  Is  presented 
that,  for  sufficiently  constrained  proolems,  is  more  powerful  than 
conventional  ai  search  methods.  This  algorithm  is  Implemented  by 
representing  Interpretations  and  constraints  as  (simulated) 
asynchronous  parallel  processes.  The  resulting  system  organization 
features  efficient  data  driver:  control  and  knowledge  sharing. 
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IV. 


SUPPUHTING  WORK 


A#  Introduction 

A  large  amount  of  ancillary  eftoit  Is  required  to  support  a 
project  of  this  scope.  Much  of  the  pr ogram-nlng  In  the  project  Is 
done  In  our  special  AI  language  QLISP.  (See  Hef.  20  for  a  general 
discussion  of  some  of  the  new  Al  languages.)  Several  additions  to  the 
power  of  QLISP  as  well  as  routine  maintenance  have  been  performed  py 

B.  M.  Wilber  and  Daniel  Sagalowicz.  These  are  described  In  Section 
IV, U  below. 

In  Section  IV, C  we  discuss  supporting  hardware  work,  Bert 
Meyer  has  been  responsible  for  the  development  of  A/D  and  D/A 
Interface  equipment  and  programs  connecting  CBC  gear  to  a  PDP/li 
computer  and  the  PDP/ii  in  turn  to  our  main  PDP/io,  A,  t.  Brain  has 
continued  his  »ork  on  our  scanning  laser  range  tinder. 

Finally,  in  Section  IV, D,  we  present  a  short  summary  of  the 

current  status  of  the  SRI  Artificial  Intelligence  Center  computer 
system. 
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The  ftrtiticlal  Intelligence  Center  uses  QMSP  [18,  20,  3S, 
67]  in  a  variety  of  appilCdtions  and  maxes  it  available  to  users 
outside  the  AlC  tor  other  purposes,  QLISP  extends  iNTtHLlSP  lb8j  to 
provide  powerful  features  for  use  in  artificial  intelligence 
applications.  It  provides  a  context  mechanism  for  hypothetical 
reasoning  and  access  to  Planning  spaces;  it  provides  automatic 
bacXtracklng  so  that  planning  can  pinch  oft  fruitless  considerations; 
it  provides  pattern-directed  function  invocation  to  simplify  the 
programming  of  case  breakdown;  and  it  provides  oattern-di rected  data 
storage  and  retrieval  to  permit  symbolic  access  to  the  data  base  at  a 
high  level  of  abstraction. 

fc.ftort  spent  on  QLISP  has  required  both  intensive  work  to 
improve  QLJSP's  behavior  within  its  scope  and  extensive  ef,.ort  toward 
extending  it.  The  Interval  of  this  report  Includes  three  major 
accomplishments,  QLISP  and  the  INTERMSP  compiler  have  been  made  to 
understand  one  another,  permitting  a  substantial  speedup  of  programs 
using  the  system.  The  pattern  matcher  has  been  replaced  with  a 
unification  program  providing  enhanced  Power  and  flexibility  at  a 
reduction  in  storage  space  and  computation  time.  we  have  designed 
and  partially  implemented  a  replacement  for  the  data  storage  and 
retrieval  mechanism,  which  we  hope  will  provide  both  true  associative 
access  and  allow  graceful  extension  to  much  larger  data  bases  than 
can  be  stored  in  any  less  drastic  extension  of  the  current  data 
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storage  system.  Finally,  since  OLISP  is  continually  developing  and 
responding  to  new  needs,  we  have  an  ongoing  program  of  fixing  new  ana 
old  bugs  and  providing  miscellaneous  other  extensions.  All  four 

areas  of  concentration  have  contributed  greatly  to  the  utility  of  the 

system,  While  only  the  second  two  of  these  areas  nave  noticeable 
extensive  components, 

A  programming  system  can  be  more  or  less  tractable  depending 
on  the  cleanliness  of  the  face  presented  the  user,  ^e  have  maintained 
a  consistent  effort  to  ensure  that  QLISP  "looxs  reasonable"  to  both 
naive  and  sophisticated  users.  At  one  extreme,  for  example,  Qlisp  is 
almost  completely  Invisible  to  the  user  (or  program)  using  none  of 
Us  special  features.  Of  greater  Interest,  however.  Is  the  face 
QLISP  presents  to  a  user  (or  program)  using  Its  features.  The 
extreme  flexibility  of  INTERLISP  has  permitted  us  to  build  a  nighlv 
automated  Interface  between  It  and  QLISP.  a  orlme  example  of  our 
efforts  to  maintain  a  clean  user  interface  appears  in  Subsection 
IV.B.I  just  below  but  a  few  points  may  be  briefly  made  here.  Even  at 
tne  TENEX  level,  access  to  QLISP  is  no  more  difficult  than  access  to 

QLISP  will  not  Intrude  on  a  user  who  Ignores  It,  but  the 

user  can  freely  intermix  LISP  and  QLISP  with  no  need  to  specially 
declare  the  presence  or  aosence  of  QLISP  in  any  segment  of  the 

program  in  question;  QLISP  system  routines  win  be  called 

automatically  wnen  appropriate  and  at  almost  no  other  '-Ime. 
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Tne  rest  of  this  section  discusses  the  work  we  have  out  Into 
ULISP  since  the  beqlnnlng  of  1^74.  Each  major  aspect  of  this  work  Is 
treated  in  a  separate  subsection#  aitnouqn  the  reader  should 
recognize  that  there  Is  Inevitably  some  degree  of  Interaction  rind 
overlap  between  the  contents  of  the  various  subsections.  The 
"staff"  of  the  ULISP  effort  has  turned  over  completely  during  this 
Interval#  with  Earl  Sacerdotl  and  Rene  keboh  turning  their  efforts 
elsewhere#  while  Michael  ^ilber  and  Daniel  Sagaiowicz  now  do  most  of 


the  work. 


The  current  level  of  effort  Is  almost  two  full-time 


People#  but  wg  expect  this  to  diminish  considerably  as  the  current 
period  of  Intensive  development  ends. 


Compiling  User  Programs 


One  of  the  great  shortcomings  of.  ULISP  was  overcome 
toward  the  end  of  1974j  users  could  not  compile  a  program  containing 
any  QLISP,  Because  of  this  conspicuous  lack#  ULISP  users  tended  to 
use  ULISP  only  tor  developing  their  algorithms  and  then#  just  for  the 
sake  of  speed#  recode  their  routines  at  no  small  expense  of  their 
time  to  use  LISP  where  it  could  be  made  to  do  Just  as  well.  We  have 
Interfaced  QLISP  to  the  compiler  In  a  manner  about  to  be  described^ 
The  resultant  speedup  of  user  programs  nas  made  ULISP  tractable  to 
many  applications  in  wnlch  People  formerly  programmed  around  QLISP 
either  ty  that  kind  of  reprogramming  or  by  avoiding  Its  use 


altogether . 


The  ULISP  system  Is  heavily  enough  used  that  we  can 


presume  the  speedup  to  have  enhanced  the  overall  performance  of  tne 
computer  system  with  the  result  of  making  more  computer  time 


available  to  all,  but  tne  number  of  variables  oreciudes  our  having 
anv  good  statistics  with  wnlch  to  back  up  this  conjecture.  However, 
this  improvement  alone  has  helped  make  uMSP  the  standard  programming 
system  for  a  large  part  of  the  CBC  system. 

ULISP  was  extended  to  compile  user  code  by  redefining 
two  of  the  interior  functions  of  the  compiler.  In  one  case,  the 
modification  was  Inessential  In  concept;  we  simply  provided  automatic 
tracing  of  compiled  functions  as  a  parallel  to  the  automatic  tracing 
provided  for  any  QLAMBDA  function  defined  by  any  other  means. 

The  other,  however,  was  essential  for  this  extended 
notion  Of  compilation  to  work  at  all;  It  entailed  the  translation  of 
any  ULISP  constructs  to  lisp  code  that  would  call  routines  internal 
to  the  QLISP  system.  First  ot  all,  the  structure  of  LISP'S  compiler 
required  the  translation  of  QLAMBDA  functions  to  the  corresponding 
LISP  code  as  a  special  case.  The  body  of  the  function  Is  translated 
In  almost  the  same  mianner  as  during  evaluation  of  an  Interpreted 
function  containing  OLISP,  When  QLiSP  code  Is  Interpreted,  we  can 
(and  In  tact  prefer  to)  translate  only  those  parts  of  the  function 
actually  being  used.  This  avoids  unnecessary  expenditures  of  time 
to  translate  possibly  large  amounts  of  code  that  may  never  get  used 
before  the  translation  must  be  discarded  for  any  of  a  number  of 
reasons,  un  the  other  hand,  when  a  function  Is  complied.  Its  entire 
body  must  be  translated  In  order  that  the  compiler  generate  the 
proper  calls  into  QLISP,  Finally,  a  small  number  of  flags  Is  used 
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to  determine  whether  to  taKe  the  time  to  translate  the  function  at 
all;  some  flags  are  set  by  the  system#  and  some  are  orovlded  for  the 
user  to  Indicate  the  presence  or  absence  of  HLISP  in  specific 
functions , 

Ti  ere  was  a  bit  of  a  challenge  to  he  met  In 
maintaining  the  compiler's  user  Interface  after  adding  the  OLISP 
Compatibility,  In  order  tnat  users  need  not  become  experts  in  the 
Inner  machinations  of  INTERLISP  or  of  OLISP#  we  needed  to  let  them 
compile#  redefine#  edit#  and  run  Individual  functions  or  files  of 
functions  In  their  Interpreted  or  compiled  forms  In  any  combination 
made  available  by  IMtHLlSP  without  any  need  to  matce  any  special 
allowances  for  the  possible  or  known  presence  or  absence  of  ULISP 
anywhere  In  the  code  in  question.  On  tne  other  hand#  this 
flexibility  Should  not  be  provided  at  a  cost  in  the  overall  system 
performance;  speed  bears  just  as  heavily  on  the  appeal  of  a  system  to 
users  as  do  flexibility  and  unobtrusiveness. 

Unfortunately,  we  could  not  simultaneously  provide 
speed  and  unobtrusiveness  in  tne  case  of  the  compiler  Interface,  Tne 
compiler  has  provisions  to  automatically  call  a  function  supplied  by 
the  user  (l,e,#  QLISP)  for  most  of  the  Places  where  QLISP  Is  likely 
to  occur#  but  unfortunately#  that  mecnanlsm  win  not  handle  all  tne 
cases  a  user  could  generate.  In  this  case#  we  were  faced  with  no 
alternative  but  to  Intercept  every  function  before  It  wa  compiled 
and  make  sure  all  QLISP  constructs  were  translated.  This  process 


approximately  doubles  the  time  taken  to  compile  any  qlven  function. 
This  Is  unavoidable  If  QLISP  is  actually  present  in  the  function 
being  complied,  hut  It  Is  ?ntlrelY  gratuitous  It  the  function  uses 
only  LISP.  we  solve  this  Problem  (to  the  extent  It  Is  soluble)  ny 
providing  the  system  of  flags  alluded  to  previously.  The  default 
state  Is  that  QLISP  Is  suspected  to  be  everywnere;  i.e  assume  that  the 
reason  the  user  is  using  uLISP  at  all  is  that  he  has  QLISP  somewhere 
In  his  code,  and  as  long  as  the  user  does  not  tell  us  ^here,  we  must 
look  everywhere.  The  user  can  of  course  change  the  default  state, 
but  It  Is  probably  more  apropos  to  Indicate  lust  where  to  look  to- 
viLiSP;  to  tnls  end,  we  provide  more  flags  to  Indicate  the  presence  or 
aosence  of  QLISP  in  a  ^hole  tile  or  in  specific  functions  in  a  file, 
wltti  each  Indication  overldinq  the  less  precise  ones. 


Finally  there  was  the  problem  of  preserving  the 
tremendous  flexibility  of  I'JTerlisp,  which  permits  the  user  to  load 
(or  refrain  from  loading)  whatever  combination  of  complied  and 
Interpreted  functions  or  files  of  functions  that  might  be  approorlate 
to  production  runs,  debugging,  compilation,  development,  or  massively 
altering  the  QLISP  program.  This  one  was  easy*  it  just  required 
that  we  realize  what  needed  to  be  done  and  exercise  sufficient 
cleverness  In  doing  it.  As  It  turned  out,  the  Implementation  was  not 
difficult.  All  we  needed  to  do  was  Install  a  routine  In  the  standard 
iNTtRLlSP  file  package  to  put  the  symbolic  file  Into  the  proper 
format  before  It  was  written  out.  This  routine  makes  slight 
alterations  in  the  format  of  the  file  from  the  foimat  the  user  may 


have  specified  and»  of  course#  It  can  cope  with  alry^ost  anythlnq  the 
user  can  specify#  especially  the  undoing  nf  its  changes  from  a 
previous  generation  of  the  file. 

The  reader  unfamiliar  with  IMTFhLISP  should  realize 
that  we  had  to  sp^end  relatively  little  time  In  actually  performing 
this  surgery  on  the  iNTtHLTSP  compiler  or  f 1 le -mal ntenance  package. 
All  the  access  points  we  needed  were  available  to  us.  Some  were 
available  as  features  deliberately  provided  for  applications  such  as 
ours.  For  example#  the  translation  can  be  forced  by  setting  a  flag 
for  the  compiler#  and  It  wm  automatically  call  DWIMUSERFN  on 
encountering  something  It  does  not  recognize?  anybody  can  define  new 
commands  for  the  file-maintenance  package  simply  by  putting  an 
appropriate  entry  on  PRETTYDbF MACHUS.  Utner  access  points  are 
available  simply  because  of  the  structure  of  INTFWLISP?  we  get  a 
first  look  at  a  function  being  complied  or  at  a  svmbolic  tile  belno 
written  by  the  artifice  of  moving  the  definitions  of  certain  critical 
functions  to  other  places  and  installing  in  their  stead  our  own 
functions#  which  do  the  preprocessing  before  calling  the  saved 
definitions . 

2.  Unifying  Pattern  Matcher 

At  the  end  of  1974#  the  pattern  matcher  In  QuiSP  was 
replaced  by  a  unification  program,  which  increased  the  power 
available  to  us  in  the  pattern  matching  operation.  The  unification 


principle  Is  explained  in  Ih^J  and  170],  ^'nen  •appropriate*  we  now 
Pnlty  two  expressions  rather  than  tiatcning  a  pattern  to  an 
expression,  The  distinction  Is  one  of  symTetry*  With  unification* 
any  variable  in  either  expre^slon  is  free  to  take  a  value*  and  all 
variables  with  a  given  name  must  take  the  scime  value  In  noth 
expressions  for  the  n.atch  to  succeed.  (Formerly*  values  could  be 
assigned  only  to  variables  occurring  In  the  expression  designated  the 
"pattern",)  For  example*  the  pattern  (CO.MNECTtID  pUMp  -X)  will  not 
match  the  expression  (CONNECTED  -Y  PLArFUR;-!)  because  the  variable  X 
can  take  no  value  to  make  the  pattern  match  the  target  expression. 
However*  if  the  pattern  Is  just  taken  as  another  expression  to  be 
Unified  with  the  target  expression*  the  two  expressions  wm  unify* 
with  sx  and  sY  taking  the  values  PLATFORM  and  PUMp,  respectively. 

The  unification  program  Is  far  easier  to  maintain 
than  the  old  pattern  matcher*  and  preliminary  measurements  Indicate 
that  despite  Its  greater  Power*  It  is  a  more  compact  and  sllgntiy 
faster  program,  while  this  change  is  too  recent  to  allow  us  to  have 
exploited  It  extensively*  the  next  tew  paragraphs  outline  some  of  the 
uses  to  Which  we  feel  It  could  be  put.  Readers  familiar  with  QLISP 
should  note  that  In  this  discussion  of  the  unlf/lng  pattern  matcher* 
we  will  use  the  term  "variable"  In  a  estrlcted  sense:  since  we  are 
concerned  with  the  assignment  of  values  to  variables  to  the  exclusion 
of  any  concern  with  tne  Instantiation  of  a  variable  to  retrieve  Its 
value*  we  will  use  the  term  to  mean  only  those  variables  that  are 
expected  to  take  values  (and  are  written  llke-X  in  OLISP),  as 


opposed  to  those  that  are  expected  fo  alreadv  have  values  (and  are 
written  like  $X). 


The  symmetry  character ist ic  of  Pattern  matching  in 


the  new  regime  can  he  used  In  several  ways. 


Perhaps  the  most 


oDVious  Is  to  con.-truct  expressions  using  varianies  supplied  oy  the 
program  In  conjunction  with  Items  supplied  to  the  program  as  data. 
For  example#  to  find  the  difference  petween  (CLASS  A  B  C)  and  (CLASS 
A  B  D),  one  need  only  unify  classes  hullt  by  adding  distinct 
variables  to  the  two  classes.  Then  each  of  the  two  variables  win 
take  for  Its  value  the  extra  item  in  tne  other  set#  as  is  necessary 
for  the  two  constructed  classes  to  unify,  if  the  two  classes  above 
are  supplied  as  trie  values  of  Si  and  $J#  then  (MATCH  (CLASS  $$I  »--X) 
(CLASS  SSJ  will  store  D  and  C  as  the  values  of  $X  and 

respectively. 


Our  new  symmetry  gives  us  a  facility  lacking  in  LISP 
(and  heretofore  also  in  QLISP)  due  to  the  traditional  conception  of 
LISP  as  a  mechanization  of  a  formal  logical  theory.  Originally  LISP 
had  the  notion,  as  did  most  formal  mathematical  theories#  that  the 
evaluation  of  a  function  generate  precisely  one  result;  if  several 
answers  are  to  be  returned#  they  are  all  coded  into  the  single 
result#  sometimes  givino  schemes  rivaling  Goedel  numbers  in 


obscurity. 


i^flth  the  emerging  concept  of  LISP  as  a  programming 


system#  functions  would  sometimes  pass  their  results  back  tnrough 
free  variables  whose  names  were  either  given  as  Dart  of  th^ 


specification  of  the  function  or  (awkwardly)  nassea  as  arouments.  t>low 
that  QLISP  variables  In  the  expression  supplied  a  QLAMBOA  function 
can  be  assigned  values  as  a  result  of  the  oattern  rratch  on  entering 
the  function#  parts  of  the  (JLAMBDA  pattern  can  be  given  as  values  to 
those  variables  during  the  match.  A  more  Interesting  case  arises 
When  a  variable  In  the  supplied  expression  Is  matched  to  a  variable 
In  :he  QLAMbDA  pattern.  Then,  when  the  pattern's  variable  Is  assigned 
a  value  In  the  body  of  tne  OLAMBDA  function,  the  value  is  passeo  back 
to  the  supplied  variable,  giving  QLISP  a  facility  analogous  to  the 
"call  by  address"  concept  of  the  Algol  thinkers. 

The  reader  familiar  with  QLISP  may  have  noticed  a 
slight  problem  that  arises,  however.  In  precisely  the  case  that  an 
expression  containing  Variables  is  supplied  as  data  to  a  OLAMRDA 
function.  The  crux  of  tne  problem  is  that  a  QLAMHDa  Implicitly 
declares  a  new  local  context  for  any  variables  occurring  In  Its 
pattern  when  the  pattern  Is  matched  to  tne  data  expression  suppUea 
It.  Since  varlaoles  that  might  occur  In  the  data  are  independent  of 
variables  In  the  program,  even  though  they  may  nave  the  same  names, 
we  should  regard  them  as  unrelated,  gf  course,  the  way  we  handle 
that  case  Is  to  enter  the  (new)  Pattern  matcher  with  an  argument 
specifying  that  It  is  performing  a  qlambda  natch.  Then  the 
uni f ler --1 . e . ,  the  (new)  pattern  matcner--oecomes  asymmetric  In  the 
sense  that  any  variables  In  the  "data"  expression  are  regarded  as 
distinct  from  any  varlaoles  occurring  in  the  "pattern"  expression 
that  may  have  the  same  names  and  receive  their  values  In  the  context 


outside  the  body  of  the  OLAMBOA  function.  This  procedure  Is  known  as 
"standardizing  variables  apart"  in  more  formal  discussions  of  the 
unification  principle. 

Unification  can  also  oe  used  to  aet  the  effect  of 
storing  universally  quantified  statements  in  the  data  base.  If  an 
expression  with  variables  is  asserted  and  then  a  query  with  variables 
is  perfortnedr  and  if  the  query  can  successfully  match  the  asserted 
expression#  then  the  result  of  the  match  may  restrict  the  query  in 
such  a  way  that  it  gains  inf ormatlon.  For  example,  if  one  asserts 
that  for  every  X,  X+l  is  greater  than  X  and  then  later  one  has  a 
symbol  A  and  desires  something  greater  than  it,  the  prober  query  wm 
produce  Afl;  in  QLISP,  it  looks  like  this:  after  performing  the 
assertion  (ASSEHT  (GT  (PLUS^-X  1)«-X))  and  then  later  the  qu.'»ry  (IS 
(GT  -Y  A)  UNIFYING),  then  (PLUS  A  1)  will  be  Stored  as  the  value  of 
$Y.  Such  a  query  presents  no  problem  to  the  unification  program,  of 
course,  but  the  access  to  the  data  base  must  be  much  more  extensive 
to  allow  for  such  a  case  because  everything  in  the  data  base  must  be 
retrieved  it  it  has  variables  in  it  that  might  let  it  unify  with  the 
query,  (The  more  usual  data  base  access  is  far  cheaper  because  the 
variables  in  the  query  inust  be  matched  to  constants  in  a  data  base 
item  for  the  item  to  be  retrieved.)  Thus,  because  of  the  relative 
expense  and  infrequency  of  this  kind  of  query,  we  require  the 
inclusion  of  the  wore  UNIFYING  in  the  query  statement. 


The  user  Interface  cons laerations  for  the  unifyinq 
pattern  matcher  are  somewhat  different  fron  those  for  the  compiler. 
Speed,  flexibility,  and  noninterference  are  the  criteria  here  tno, 
but  at  least  we  do  not  nave  to  allow  tor  reasonable  behavior  in  the 
face  Of  as  wide  a  range  of  user  behavior.  Such  a  consideration  has 
again  shown  up:  the  implied  generality  Includes  a  very  expansive 

case  of  relatively  little  Interest,  and  so  we  require  the  user  to 
specifically  indicate  the  appropriateness  of  the  "bad"  case.  Here, 
we  prefer  that  the  genei-al  case  be  the  default;  however,  the  marginal 
cost  is  so  great  tnat  the  marginal  utility  is  very  small.  Therefore, 
we  specify  the  defaults  here  to  be  just  the  opposite  of  what  they  are 
in  the  case  of  the  compiler.  There  tne  cost  is  a  mere  factor  of 
two  in  an  operation  (i.e.,  compiling)  that  is  not  done  too  often,  and 
the  benefit  is  that  everything  will  be  handled  correctly.  On  the 
other  hand,  the  general  handling  of  this  "bad"  case  would 
significantly  increase  the  expense  of  retrievals  from  the  data  base, 
a  frequent  operation,  and  user  programs  would  usually  realize  no 
benefit.  Of  course,  another  aspect  of  tne  face  (ILTSP  presents  to 
its  user  is  exemplified  by  the  tact  that  these  modes  of  ooeratlon  are 
built  Into  the  system  only  as  Its  default  choices  tor  the  case  that 
the  user  does  not  indicate  a  preferred  mode  of  operation.  This  is 
Why  we  can  be  so  apparently  cavalier  about  a  factor  of  two;  if  the 
guess  causing  it  is  Incorrect,  the  user  can  easily  correct  it. 


3 


Data  storage 


As  another  part  of  the  QLISP  developments  are 
currently  worklno  on  a  new  data  base  organization.  In  the  next 
paragraphs  we  are  going  to  present  successively  the  old  data  base 
organizations  called  the  Discrimination  Nets  and  Its  possible 
deficiencies;  the  Ideas  behind  the  new  organization  and  Its  possible 
advantages;  and  finally  some  of  the  deeper  details  of  the  new 
organization.  This  new  data  base  organization  is  In  a  stage  of 
development  and  about  three  wan-montns  n^ve  been  spent  on  It, 
consequently,  the  details  are  still  sicetcny  and  It  Is  still  too  early 
to  Say  whether  the  justifications  presented  In  the  next  paragraphs 
are  confirmed  by  experience  or  whether  some  major  problems  are  going 
to  appear  that  cannot  oe  overcome, 

a.  The  Discrimination  Net»-organlzatlon  and 
Discussion 

The  discrimination  net  organization  is  based 
on  what  Is  known  In  the  literature  as  the  "trie"  technique  171-7JJ, 
Our  own  Implementation  was  devised  by  Jeff  Ruilfson  and  greatly 
optimized  by  Rene  Reboh,  Althouqn  It  Is  not  the  purpose  ct  this 
report  to  present  the  details  of  tne  discrimination  net,  we  think  It 
would  be  useful  to  explain  It  In  general  terms  with  a  few  very 
trivial  examples.  Let  us  suppose  that  a  user  executes  the  following 
QLISF-llke  statement:  ( ASSERT (CONNECTED  PUMP  PLAT  FORM ) In-cont ex t 


Cl),  This  Inserts  the  record  Hi:  {NErEXPHESS10i>i(C0NNLCTE;u  pump 
PLATFUHM)  [CUMEXT  C 1  ( MODELV ALUL  THUE  )  J  >  into  the  data  base.  Since 
there  is  only  one  record  in  the  data  base,  the  organization  tree 
(also  known  as  the  discrimination  tree)  has  only  one  node  that  points 
to  the  (unique)  record  Hi,  Then  the  user  executes  the  following 
QLISP-llke  statement:  ( ASSERT (DISCONNECTED  pump  PLAfFURM) In-context 
C2),  Then  the  data  base  gets  a  secopo  record;  R?: 

{ NETEXPRESSION ( DISCONNECTED  pUMp  PLA IFORM ) ICON  TEXT  C2 ( MODELVALUE 
true)])  Now  the  discrimination  tree  has  two  terminal  nodes  ,  one 
Pointing  to  HI  and  one  pointing  to  R2.  But  to  enable  the  retrieval 
operations  to  distinguish  easily  between  these  two  nodes  a  third  one 
is  created;  it  is  only  a  discrimination  node  with  just  the 
information  necessary  to  distinguish  HI  and  R2.  In  this  example  the 
needed  information  is  that  the  two  records  differ  by  the  first 
element,  which  in  the  first  case  is  CONNECTED  and  in  the  second  case 
it  is  DISCONNECTEO-»as  indicated  in  Figure  54. 


FIGURE  54  A  DISCRIMINATION  TREE  WITH  TWO  NODES 
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If  now  a  third  assertion  is  executed  such  as 
(ASStHTCDlSCONNECTED  PUMP  PUMP-PULLEY )  1  n-context  Cn»  '"hen  a  third 
record  is  created,  and  the  discrimination  tree  now  has  three  terminal 
nodes  and  two  discrimination  nodes#  ?s  follows.  The  first  node  is  as 
before  and  distinguishes  between  R1  and  the  rest,  the  second  one 
distinguishes  between  P2  and  R3.  Figure  55  snows  the  result  and  is 
self “eypidnatory , 
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FIGURE  55  THE  SAME  DISCRIMINATION  TREE  WITH  A  THIRD  NODE  ADDED 

Already  at  this  point  a  number  of  remarks  may 
be  made  without  going  any  deeper  into  the  details  of  the 
Discrimination  Net  implementation.  First,  each  record  Is  in  fact 
composed  of  two  Parts;  Its  "name"  proper  (e.g,,  (CONNECTED  PUMP 

platform))  and  a  list  of  triples  of  the  form  (context-name 
proPerty-name  proper ty-vaiue )  (e,o,,  (Cl  MODELVALUE  TRUE)),  It  is 
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Important  to  notice  that  the  discrimination  tree  Itself,  which  Is 
used  for  data  retrievals,  does  not  Include  any  Information  about  the 
properties.  This  Is  due  to  the  basic  philosophy  of  the 
discrimination  tree,  and  such  Information  cannot  be  added  to  it  In 
any  way;  once  a  record  is  attached  to  a  terminal  node  It  remains 
attached  to  that  node  no  matter  how  Its  properties  are  modified,  said 
In  other  words,  the  discrimination  is  only  based  on  syntactic 
Infoimcitlon  and  not  at  all  on  semantic  contents.  The  testing  of  the 
property  values  win  still  be  done,  but  as  an  "after-pass";  l.e., 
after  all  the  records  that  Pass  the  discrimination  testing  have  been 
assembled  together.  This  may  correspond  to  a  waste  of  time,  which 
could  theoretically  be  avoided  with  a  diffe.ent  scheme  If  that  scheme 
were  to  use  the  semantic  Information  to  alci  In  that  discrimination. 
In  other  words,  we  are  looking  for  a  scheme  that  keeps  both  semantic 
and  syntactic  Information  In  the  structure  that  Is  going  to  be  used 
In  the  data  retrievals. 


A  second  Important  remark  Is  thee  the 
semantic  contents  of  the  data  base  bears  very  little  Influence  on  the 
way  the  discrimination  tree  develops  Itself,  it  Is  even  amusing  (If 
not  very  profound)  to  notice  that  for  the  same  records  stored  In  the 
data  base,  the  organization  tree  may  be  very  different  depending  on 
the  order  In  which  these  records  were  stored,  fjne  of  the 
consequences  of  this  tact  is  that  the  amount  of  Work  needed  to  do  a 
retrieval  Is  more  or  less  Independant  of  the  semantic  contents  of  the 
data  base,  but  depends  heavily  on  the  number  of  nodes  In  the  tree,  or 


more  precisely  on  the  width  and  depth  of  the  tree.  To  put  it 
differently,  after  a  long  data  base  development,  it  can  be  expected 
that  on  the  average,  every  retrieval  win  be  long,  since  It  wUl  have 
to  go  through  a  great  number  of  discrimination  nodes,  and  this 
complexity  will  be  more  or  less  Independent  of  the  number  of 
reasonable  candidate  records  resulting  from  a  given  retrieval 
request.  This  last  point  Is  Important,  since  It  is  generally  felt 
that  a  good  retrieval  scheme  should  have  an  expected  retrieval  tltr.e 
roughly  proportional  to  the  size  of  tne  retrieval  result. 


The  third  criticism  of  the  Discrimination  Net 
is  also  related  to  the  lack  of  semantic  information  in  the 


organization  of  the  discrimination  tree. 


Because  of  this  lack, 


there  is  no  way  for  the  language  to  decide  how  the  data  base  should 
be  organized  on  peripheral  mass  storage  files,  when  we  need  to 
overlay  the  data  out  of  tne  main  memory.  This  task  will  somehow  have 
to  be  left  to  the  users.  Concerning  tnls  last  point  two  remarks 
Should  be  made.  First,  In  the  environment  In  which  ULISP  has  been 
known  to  operate  In  the  past,  i.e.,  the  research  environment,  a 
strong  case  may  be  made  that  most  users  do  not  know  how  their  data 
should  be  organized  on  peripheral  files  In  order  for  tnelr  programs 
to  be  efficient.  Moreover,  even  if  each  of  them  knew,  the  tact  that 
the  same  data  base  Is  used  by  various  users  of  different  needs  would 
necessitate  that  these  users  get  together  and  decide  collectively  how 
to  organise  the  data  base;  the  result  would  be  a  division  of  the  data 
Ihto  a  great  number  of  small  ''buckets"  In  which  the  records  are 


stronqiy  related  In  a  semantic  sense.  It  Is  our  contention  that 
such  a  subdivision  is  qolno  to  be  difficult  to  create  unless  it  is 
done  automatically  by  the  data  base  storage  mechanism,  in  our  case 
QLISP  Itself.  The  point  is  tnat  the  Discrimination  Net  does  not  qive 
QLIS?  any  help  whatsoever  In  that  direction. 


It  would  be  unfair  not  to  mention  at  this 
point  some  of  the  possible  advantages  of  the  Discrimination  Net.  The 
main  one  is  that  it  works  and  has  been  working  satisfactorily,  if  not 
efficiently,  tor  the  past  few  years.  The  second  one  Is  that  It 
probably  requires  less  storage  than  anything  else  we  could  devise. 
And  finally,  all  the  disadvantages  mentioned  above  are  subject  to 
strong  discussion  and  wm  have  to  be  measured  In  comparison  with 
Whatever  other  scheme  we  may  Implement. 


b. 


Proposal  for  a  New  Data  Base  Organization 


After  an  extensive  search  of  the  literature. 
It  appeared  to  us  that  only  two  types  of  data  base  organization  could 
be  attractive  for  ULlbP  to  use;  one  is  the  trie  technique,  of  wnlch 
the  discrimination  net  Is  one  example;  the  other  Is  the  Inverted 
index  technique.  Essentially  al]  the  trie  techniques  would  have  the 
same  types  of  disadvantages  as  the  Discrimination  Net,  and  many  of 
them  would  not  be  attractive  for  QLISP.  Thus  it  was  logical  to  try 
the  other  possible  type. 
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Let  us  quicicly  explain  oy  an  example  now  the 
Inverted  Index  works.  The  records  stored  In  the  data  base  are  the 
same  as  in  our  example  used  for  tne  Discrimination  Net,  The  first 

record  HI  Is  stored  In  the  same  way»  but  In  the  data  base  we  add  a 

new  structure  called  the  Inverted  index  which  has  a  number  of  nodes 
called  CONNECTED,  PlJMF,  PLArFOHM,  CUNTEXT-Cl,  MODELV  ALIJL ,  and  THIIE, 
Under  each  of  these  nodes  we  out  a  pointer  to  PI,  when  the  second 
record  H2  Is  added  we  create  two  new  nodes  In  the  Inverted  index 
called  DISCONNECTED  and  C0NrEXT-C2,  Moreover,  we  put  a  pointer  to  H2 
under  the  nodes  DISCONNECTED,  PUMP,  PLATFHHM,  CONTEXT-CI,  MUDELVAF.UK, 
and  TRUE,  Now  some  of  the  nodes  have  two  pointers  ,  some  nave  only 

one.  After  the  third  record  Is  added,  the  Inverted  Index  looks  like 

this : 

CONNECTED:  Rl 
DISCONNECTED:  R2  R3 
PUMP:  Rl  H2  Rj 
PLATFORM:  Rl  H2 

PUMP-PULLEY:  K3 
CONTEXT-Cl:  Rl  R3 
C0NTEXT-C2:  R2 
MODELVALUE:  Rl  H2  P3 

TRUE:  Rl  R2  R3 

Five  keep  building  the  data  base  In  this  way, 
When  a  retrieval  Is  attempted  the  algorithm  is  quite  simple,  at  least 


in  theory:  we  are  lootclng  for  every  record  that  mentions  tne 
PLAU  f]K(.w  we  look  in  the  inverted  index  tor  the  node  PLATKiJHi'i  and 
find  these  records  immediately.  It  we  look  for  ai]  objects  connected 
to  the  platform  in  context  C2,  we  take  the  intersection  of  the  nones: 
PLATfUPM,  MOhELVALUE,  TkUE,  and  CUMNEC  FEU .  Au  this  is  Very  simple 
and  quite  well  known»  but  it  has  one  major  inconvenience,  Tacvinq  fhe 
intersection  of  oiq  sets  is  a  long  opera tion»  and  the  length  of  that 
operation  is  not  related  to  the  size  of  tne  result  but  to  the  size  of 
the  sets  with  which  one  started.  This  Is  considered  to  be  a  niajor 
disadvantage  of  sucn  a  technique.  In  our  example,  to  find  all  the 
Objects  that  are  connected  to  the  PUMP-PPlley  In  context  Cl,  we  would 
take  the  intersection  between  five  nodes  (COf^NECTE'D ,  PUMP-PULLRY, 
CUNrExT"Cl»  MODELVALUE»  and  TRUE)  to  find  out  that  there  is  no  such 
object;  this  is  a  very  troublesome  loss  of  time. 

To  alleviate  this  problem,  we  can  use  the 
technique  of  subdividing  the  indices  by  forming  some  of  the 
interactions  when  data  are  stored.  Then,  the  index  at  any  given  node 
may  itself  be  indexed  by  some  other  index  nodes  before  yielding  a 
list  of  records.  In  our  example,  the  index  tor  DISCONNECTED  could  be 
subdivided,  with  the  next  level  of  indexing  distinguishing  CONTEXT-Cl 
from  C0NTEXT-C2,  The  result  would  be  that  under  each  Index  the  list 
Of  records  would  be  Shorter  and  the  intersections  easier  to  do.  The 
indices  that  have  been  subdivided  would  point  to  their  subdivisions. 
The  question  then  is:  which  Indices  should  be  subdivided?  If  they 
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are  subdivided  to  the  point  where  they  cannot  be  subdivided  anymore, 
then  we  would  create  a  hune  number  of  indices  and  the  inverted  index 
structure  would  be  bigqer  than  the  rest  ot  the  data  base,  which 
clearly  would  be  inefficient.  Un  the  other  hand,  if  we  subdivide 
them  only  to  a  predefined  depth,  then  there  win  always  be  some 
indices  on  which  the  intersections  would  be  too  costly. 

In  the  implementation  we  are  thinking  about, 
we  have  solved  this  problem  in  the  followino  way.  Under  each  index 
we  keep  account  of  the  number  of  records  it  noints  to;  when  this 
number  becomes  '_oo  large--!. e.,  bigger  than  a  given  threshold  (which 
is  user  modltiable)--then  the  index  is  subdivided.  In  this  way  we 
guarantee  that  no  Intersection  will  occur  over  sets  that  have  a  size 
bigger  than  the  threshold.  Of  course  we  also  give  the  user  the 
possibility  to  declare  that  some  Indices  must  always  be  subdiviaed  or 
must  never  be  subdivided. 


The  influence  of  the  threshold  on  the  way  the 
data  base  operations  behave  is  not  a  simple  one.  When  the  threshold 
is  small,  the  number  indices  becomes  large  and  tnprefore  the 
Inverted  index  list  becomes  large;  also  the  time  taken  by  the 
intersections  becomes  small,  but  it  oecomes  more  difficult  to  get  to 
the  point  Where  the  actual  intersection  occurs,  Un  tne  other  hand, 
the  data  base  operations  that  end  up  taking  unions  of  sets  of  records 
definitely  become  longer.  It  therefore  win  oe  necessary  to  measure 


Whether  the  advantage  ot  faster  intersections  outweighs  the  other 


disadvantages.  It  may  be  that  tor  a  given  program  there  is  an 
optimal  threshold,  and  the  dltficmty  win  be  to  find  what  it  is. 


In  this  new  data  base  organization  the  user 
has  the  choice  of  the  "subdivision  threshold"  as  we  have  just  seen 
above.  However,  this  Is  not  the  only  freedom  ne  has.  At  the 
beginning  of  this  subsection,  we  saw  that  the  "basic  Indices"  are  the 
elements  of  the  record  name,  the  context,  the  property  names,  and 
values.  in  fact,  this  does  not  need  to  be  so.  The  user  win  be 
given  the  choice  of  decidina  what  are  his  basic  Indices.  in  some 
cases,  he  may  decide  that  a  property  name  or  value  is  not  needed  as  a 
basic  index,  mainly  because  no  associative  retrieval  win  ever  be 
done  on  it,  or  that  It  win  be  so  rare  that  the  disadvantages  of 
havlno  it  as  a  basic  index  outweighs  its  advantages. 


At  this  Point  We  have  given  the  general  loeas 
Of  our  new  implementation  and  win  leave  some  of  the  more  Intricate 
details  for  the  next  subsection.  It  Is  now  time  to  exolain  why  we 
feel  that  we  may  have  solved  some  or  all  of  the  problems  we  think 
occur  with  the  Discrimination  Net.  The  main  point  Is  that  now  the 
"inverted  list"  Includes  both  syntactic  and  semantic  Information.  All 
of  these  may  be  used  during  associative  retrieval  and  no  additional 
pass  is  necessary  for  the  semantic  Information  testing  alone. 

The  second  point  Is  that  now  the  retrieval 
time  is  roughly  proportional  to  the  size 


of  the  result  of  the 


associative  retrieval  which,  as  inentloned  earlier,  is  a  sought-after 
characteristic  of  "good"  associative  retrieval  techniques,  with 
respect  to  this  point,  it  should  oe  noted,  thouqh,  that  we  do  not 
Know  at  this  time  whether  the  associative  retrie'^al  time  is  not 
always  too  long,  and  in  particular  always  lonaer  than  the 
corresponding  time  used  in  the  Di scr Imlmat ion  Net  technique;  it  this 
is  the  case,  obviously  the  whole  thing  would  be  a  failure. 

The  final  point  concerns  the  problem  of 
storaae  on  peripheral  devices.  When  a  new  record  is  put  into  the 
data  base,  the  question  wm  ne  wpere  to  out  it  outside  of  main 
memory.  As  mentioned  orevlously,  a  reasonable  answer  is  to  put  it 
in  a  "small  bucket"  with  other  records  that  are  strongly  semantically 
related.  Such  a  bucket  may  just  be  the  list  of  records  that  are 
pointed  to  by  the  smallest  sublndex  list  on  which  the  record  is  also 
located.  The  fact  that  this  list  is  the  smallest  may  very  well 
indicate  that  this  suolndex  has  a  strong  semantic  meaning,  and  this 
may  'be  enough  to  have  a  reasonable  peripheral  tile  organization. 
This  point  will  be  investigated  further  if  the  new  data  base 
organization  appears  to  be  competitive  with  the  Olscr Imlnatlon  Net, 

In  summary,  it  appears  to  us  at  the  present 
time  that  this  new  organization  does  satisfy  the  objectives  that  we 
specified  in  the  first  subsection;  however,  there  are  still  two  big 
unknowns  that  win  be  resolved  only  when  tne  implementation  is 
completed  to  a  fairly  advanced  point.  First,  it  is  not  clear  what 


time  Improvement  we  are  qolna  to  qet;  second,  it  Is  not  clear  how 
much  more  space  wm  be  required. 

c.  Some  Additional  Details  on  the  Inverted  Index 

In  subsection  b  above  we  qave  the  qenerai 
Ideas  on  the  new  or qanlzatlon j  however  a  lot  of  details  Interfere  and 
ma<e  the  actual  Implementation  much  more  Intricate,  As  the  reaier  may 
know,  OLISP  has  three  different  types  of  data:  tuples,  baqs,  and 
classes.  (live  do  not  mention  vectors,  whlcn  for  the  present 
discussion  are  the  same  type  as  tuples).  we  wm  quiociv  define 
these  three  data  types  by  their  characteristics:  tuples  are  the 
n-tuples  of  ordinary  mathematics:  bans  are  Its  multisets  (loosely. 
Sets  that  can  have  repeated  elements)*  and  classes  are  Its  classes 
(or  sets).  For  example:  (TUPLt:  A  B)  is  not  equal  to  (TUPLE  b  A), 
(BAG  A  E  A)  Is  equal  to  (BAG  A  A  B)  but  net  to  (BAG  A  B),  (CLASS  A  B 
A)  Is  equal  to  (CLASS  A  B).  These  various  equalities  or  Inequalities 
have  to  appear  correctly  In  the  way  the  Indices  are  chosen.  If 
(TUPLE  A  B)  Is  put  Into  the  data  ease  we  need  more  than  Just  the 
three  Indices  TUPLE,  A,  and  B  because  this  would  not  dlstlnqulsh  It 
from  (TUPLE  B  A),  Similar  remarks  apply  to  baos.  The  solution 
adopted  Is  as  follows  (in  spirit  but  not  quite  In  realization). 

(TUPLE  A  B)  corresponds  to  the  Indices; 
irUPLEA  21UPLEB  3TUPLE  (this  last  one 
corresponds  to  the  lenqth  of  the  record). 


(BAG  A  H)  corresponds  to  toe  indices: 


IBAGA  IBAGH  3bAG  (the  lenqth  dqaln), 

(BAG  A  A  B)  corresponds  to  the  indices:  ii.AGA 
2BAGA  IBAGB  4BAG. 

(CLASS  A  B)  corresDonds  to  the  Indices: 

CLASSA  CLASSB  3CLASS. 

Let  us  see  now  how  a  data  retrieval  is 
oerfomea  oy  looklnu  at  some  examples.  Let  us  consider  a  request  of 
the  type  (TUPLE  A  -K  C)  Where  >-X  stands  for  "any  element".  This  jurt 
means;  find  all  records  that  have  the  indices:  iTlipLtA  3TUPLEC 
4TUPLE#  and  is  easy  to  satisfy.  In  the  same  way*  the  request  (bAG  A 
-X  C)  corresDonds  to  all  records  that  nave  indices  IBAGA  loAGC  4BAG. 
Note  that  in  this  last  case  some  of  the  records  may  also  have  2BAGA 
or  2BAGC  as  a  possible  index,  until  now  every:hina  nei’.^ves  nicely. 
Things  become  sllqhMy  more  cuopersome  with  the  next  example;  assume 
the  request  (TUPLE  A  .-♦-X  C)  where  .-.-X  stands  tor  "any  number  of 
arguments,"  (In  other  words  this  request  is  matched  by  (TUPLE  A  C)  as 
well  as  by  (TUPLE  A  B  C  D  E  E  ."J  C ) , )  Then  the  matching  records 
certainly  have  the  index  ITUFLEA  out  their  next  two  Indices  will  oe 
one  Of  the  pairs  (2TUPLEC  3TUPLE),  OTUPLEC  4TUPLe),  and  so  on. 
The  associative  retrieval  becomes  much  more  complex,  (In  the  first 
implementation*  we  will  just  use  1 TUPLEA  as  the  index  and  forget 
about  the  fact  that  there  is  also  a  C  at  the  end  of  the  record). 
The  similar  case  behaves  very  nicely  with  haqs  and  classes  and  does 
not  need  to  be  mentioned. 


In  oLISP  the  "ndme"  of  a  record,  l.e.  Its 
syntactic  content,  may  be  any  lISP  expression:  for  example,  (TUPLE  A 
(TUPLE  b  OD)  IS  a  perfectly  legal  OLIbP  expression  to  be  stored  in 
the  data  base.  This  Is  In  fact  stored  as  two  records:  (TUPL»'  p  C) 
^hich  IS,  say,  record  Ri ;  and  (TUPLE  A  :ri  O)  wnere  :Ri  stands  for 
'pointer  to  Rl".  As  far  as  storing  these  records  Is  concerneg,  the 
Implementation  Is  straightforward;  the  record  (TUPLE  A  ;hi  D) 
corresponds  to  the  Indices:  liuPLEA  2TUPLE:Hl  31JPLED  4TUPLK..  The 
difficulties  start  with  the  retrieval.  How  do  we  satisfy  the 
request:  (TUPLE  A(TUPLE  B  <-x)D)?  Tnere  are  two  ways  to  satisfy  it. 


We  can  start  by  finding  all  records  that  match  iTUPLE  B  -X),  call 
them  RXl  rtX2  HX3  then  find  wnlch  of  the  records  (TUPLE  A  ;hxi  D) 
(TUPLE  A  ;PX2  D)  ,,,  exist  in  the  data  base.  L)r,  wp  may  try  to 
directly  find  all  records  that  matcn  (TUPLE  A  -f  D)  and  Intersect  the 
records  that  replace  -Y  with  the  list  (KXl  RX2  ...).  in  our 
preliminary  Implementation,  we  use  the  second  scheme:  we  find  all 
records  matching  (TUPLE  A  .-Y  D)  and.  If  there  are  not  loo  many  of 
them,  we  give  all  of  them  to  the  "pattern  matcher"  which  will 
eliminate  the  nonmatchlng  ones.  If  there  are  too  many,  we  start  all 
o/er  and  try  tne  first  scheme.  The  reason  why  we  chose  this 
implementation  Is  that  It  was  much  easier  to  code  and  debug  and  we 
wanted  something  running  fast  to  test  the  Ideas;  however.  It  Is  clear 
that  this  Implementation  Is  costly  both  In  time  and  In  space  (by  the 
unnecessary  "conses"  It  generates)  and  If  the  new  data  base  Ideas 
loo<  promising,  this  win  have  to  be  Improved  upon. 


3T1 


Finally*  the  last  level  of  ditticuitv  is 


caused  by  i  totally  different  type  of  retrieval  which  is  possible  in 
OLISP,  This  can  be  called  the  pattern  retrieval;  a  ns(»r  may  as<  to 
find  all  patterns  that  match  a  aiv®h  datum.  For  example*  one  mioht 
asK  to  find  all  patterns  matchinq  (TUPlk,  A  13)  and  would  expect  to  dp 
given  back  records  like  (TUPLE  A  b),  (TUPLE  A  -X),  (TUPLE  B),  and 
(TUPLE  “-X  *-<-Y ) ,  we  will  refer  to  this  as  the  pattern  retrieval;  this 
turns  out  to  be  the  most  difficult  data  base  operation  to  implement. 
Let  us  try  to  explain  how  we  attempted  to  solve  this  problem.  in 
the  example  above*  we  are  given  tne  data  (TUPLE  A  B);  what  are  the 
possible  indices  of  tne  matchinq  patterns?  A  matchinq  pattern  could 
have  ITUPLEA  but  may  not;  it  could  have  2rUPLEB  but  it  may  not;  it 
could  have  3TUPLE  but  again  it  may  not.  In  fact,  at  this  point  it 
looks  as  though  we  do  not  know  anything  about  tne  patterns.  Tnat  is 
not  quite  true*  luckily  enough;  it  the  pattern  does  not  have  ITUPLEA 
as  an  index  It  must  have  something  like  llu''.L-X  or  lTUPLE»-.-j(.  If 
it  has  ITUPLEA  or  ITUPLE-X  and  does  not  nave  2TUPLEH*  it  must  nave 
2TUPLE<-X  or  2TUPLE»-‘-X,  However*  it  it  has  nuPijE<-<-x*  then  it  may 
very  well  have  nothing  else*  or  rather  it  may  very  well  have  only 

'2TUPLK  or  3TUPLE  and  so  on.  The  algorithm  to  solve  this  simple 
pattern  retrieval  is  already  quite  cumbersome;  it  becomes  even  more 
cumbersome  when  treating  the  following  one. 

Let  us  assume  that  we  are  alven  the  followina 
data  and  we  are  looking  for  the  matching  patterns:  (TUPLE  A(TUPLE  B 
C)D),  We  then  nave  tne  same  problems  as  with  the  last  example*  plus 
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•5  new  one.  we  nave  to  find  all  tne  patterns  that  match  (TUFLt;  B  C) 
and  add  that  level  of  comoiexit/  to  tne  anorlthm.  Here  again  two 
strategies  tray  be  taken,  we  may  first  do  the  pattern  retrieval  for 
(TUPLE  B  C)  and  then  do  the  Pattern  retrievals  for  the  things  hkc 
(TUPLE  A  :Hx  D);  this  Is  conceptually  simoie  out  generates  a  lot  of 
useless  records  PX  and»  therefore*  a  lot  of  useless  pattern  retrieval 
attempts.  (Jr  we  may  start  py  doing  a  pattern  retrieval 
corresponding  to  (TUPLE  A  ;h^  D)  where  :R^  corresponds  to  "any  record 
With  a  or--x  in  it"  and  then  Intersect  the  resulting  list  of  :R^ 
with  the  records  matching  (TUPLE  B  C).  The  latter  alternative  is 
essentially  the  attitude  we  are  taking  (with  the  same  restricted 
implementation  mentioned  In  the  data  retrieval  part  above).  Adoption 
of  thli  strategy  causes  storage  of  a  new  record,  such  as  (TUPLE  A 
(TUPLE  B  <-X)),  to  generate  the  indices  1 TUPLEA  2TnpLE;H^  2TUpLE:h1 
3TUPLL.  The  record  HI,  wnlch  is  the  name  of  (TUPLE  B  -X)  has  the 
indices;  nuPLEb  2TUPLE^X  3TUPLE, 

There  are,  of  course,  a  lot  more  details  to 
the  Implementation  than  those  just  given.  However,  these  details 
already  give  the  reader  a  general  feeling  ot  the  difficulties 
Involved  which  did  not  appear  in  the  general  ideas  mentioned  in 
subsection  b,  it  is  Important  to  know  tnat  these  difficulties  are 
present  because  they  are  the  main  cause  of-  time  and  space 
Inefficiencies.  It  is  the  solution  of  these  details  that  will 
allow  or  disallow  the  whole  idea  to  be  a  viable  one. 
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Mdint  endnce 


Maintenance  oroduces  no  :TiilPStones  but  is  crucial  to 
tne  utility  of  a  aeveloping  system,  .^*6  continually  try  to  Keep  OblSF 
as  current  as  possible;  this  includes  fixing  bugs  reasonably  quiCkiy 
after  they  are  found  and  trying  to  minimize  the  lag  between  the 
arrival  of  a  new  version  of  LISP  and  the  app'^arance  of  the  matching 
QLISP.  W.Mie  this  task  is  nominal  in  extent,  its  requirements  are 
often  unpredictable  and,  since  it  can  occasionally  take  up  to  half  of 
one  person's  time  (averaged  over  a  month),  it  can  sometimes  have  a 
noticeable  effect  on  the  progress  of  developmental  tasks,  however, 
the  Importance  of  this  task  leads  us  to  give  it  a  high  priority  most 
of  the  time. 


we  provide  a  fast  turnaround  on  repairing  bugs  in  the 
system  and  providing  minor  extensions.  Users  need  wait  only  a  couple 
of  hours  (and  never  more  than  24)  to  continue  using  OLISP  without 
needing  to  program  around  the  flaws  they  discover,  A  high  priority 
has  also  been  given  the  release  of  a  new  ULISP  to  go  along  with  every 
new  Version  of  LISP,  so  tpat  QLISP  users  may  begin  using  the  new  LISP 
as  soon  as  possible  after  its  arrival.  Under  normal  circumstances, 
the  job  of  loading  a  new  QLISP  and  performing  various  associated 
ancillary  tasks  would  take  an  hour  or  less»  but  in  our  case  this  time 
is  sometimes  increased  to  as  much  as  several  days  by  two  special 
circumstances.  First  of  all,  the  parts  of  QLISP  directly  concerned 


with  its  interface  to  LISP  are  much  more  sensitive  to  details  of  the 


Inner  structore  ot  I.‘'IlPLI5P  tnan  T^st  otner  LISP  progran-s.  For 
exa'^plef  the  functions  in  JL15P  tnat  reoiace  parts  of  the  co'^Fller 
njst  nave  tre  sa-e  nUTCer  of  arguments  (of  the  saae  nanes)  as  the 
standard  furctlons  uhey  replace.  since  I'.fFPLlSP  is  also  In  a 
continual  state  of  deve  locT.ert ,  s.icn  details  wm  change  froir  tirre  to 
tine.  Also,  rew  versions  of  LISP  freguently  have  now  features 
adapted  to  (and  otter  xotlvated  oy)  the  constantly  increasing 
requirements  of  GlISP;  we  try  to  use  the  new  features  rlgnt  a  wav,  but 
if  testing  reveals  they  no  not  wor<,  we  lUst  patch  around  them  until 
the  arrival  of  the  next  version  of  LISP.  ine  Processes  of  removino 
old  Patches,  testing  the  resultant  Gf  iSP,  and  oossloly  ihstalllng  new 
patches  can  conslderady  extend  the  time  required  to  orihg  up  a  new 
GLI5P. 


we  put  a  high  value  on  upwaro  compatlpility;  we 
always  endeavor  to  restrict  our  changes  to  tne  Kinos  that  extend  tne 
language  without  Invalidating  programs  a  user  nay  already  have, 
at  this  endeavor  Is  required  tor  us  to  retain  any  given  user 
for  any  considerable  lenqtn  of  time,  Althougn  this  does  not  compete 
for  Tuen  of  our  time  witn  th®  other  aspects  of  tne  GLISP  effort,  it 
Is  something  we  rust  always  Keep  in  mind  as  we  change  the  GLISP 
system.  Unfortunately,  we  cannot  always  maintain  the  continuity  we 
wish.  Sometimes  overriding  considerations  dictate  a  change  in  the 
user  Interface  reguirlnq  a  change  in  GLISP  programs.  A  program 

can  produce  correct  results  by  virtue  of  a  oug  which  masKs  a  hug  in 
GLISP  and  is  masked  by  It.  Wnen  the  ULISP  oug  Is  fixed,  the  program 


buq  takes  its  toll.  We  try  to  mlnlniize  those  chanoes  that  are  rot 
upwardly  compatible,  but  they  unfortunately  cannot  be  elimlnatea, 

5.  Summary 

We  fiave  now  described  how  we  have  directed  the  part 
of  this  project  devoted  to  ULISP,  Major  results  are  in  trie  areas  of 
compilation  of  user  programs,  a  unification  pattern  matcher.  and  a 
new  organization  of  the  data  storage  mechanism.  i*nile  we  also  have 
continued  an  ongoing  task  of  routine  maintenance.  In  our 

undertakings.  we  fiave  always  kept  sight  of  a  rilgher  goal:  that  of 
providing  a  reliable,  dependable  programming  system  that  permits 
users  to  concentrate  on  tnelr  own  programs  with  minimal  distraction 
from  bugs  or  other  awkward  characteristics  QLISP  may  have, 

C,  Hardware  work 

1.  Interface  Fgvilpment 

The  Interface  con f lour at i on  of  th»  nresent  CMC  svstem 
is  Shown  in  Fioure  56.  The  general  approach  is  to  use  the  local  ivp 
and  PDP-11  simply  as  an  i /rj  processor  for  the  PDP-10,  All 

calculation  and  control  wm  reside  in  the  POP-ir,  while  the  PDP-11 
takes  care  of  the  localized  real-time  commands  and  control  of  the 
peripherals.  All  PpP-ll  interfaces  are  Implemented  with  standard  DEC 
modules  and  hardware.  The  Analoo-to-Dinitai  converter  is  a 


PDP-10 


SA-3805-37 


FIGURE  56  IMTtRFACE  CONFIGURATION 

multiplexed  12-blt  device  fabricated  of  standard  nodules.  The 
Dldltal-to-Analoa  converters  (also  12-blt)  orovlde  analoa  x-v 
position  commands  to  the  ranoe  finder. 

In  use,  then,  the  Pl)P-)1  does  the  followlnq.  When  a 
LISP  program  In  the  PPP-IO  grants  to  move  the  camera.  It  sends  to  the 
PDP-li  the  desired  pan  and  tilt  annlesj  the  PhP-n  then  starts  the 
pan/tllt  head  movlno  In  the  prooer  direction  and,  via  the  A/D 
converter,  monitors  Its  position.  When  either  anale  reaches  the 
desired  position  the  rotation  Is  stooped,  and  when  both  angles  are 
stopped  a  signal  is  sent  to  the  PnP-lO  to  so  slgnlfv. 
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If  a  L  5P  nronran  desires  a  ranoe  ’"Pas'irerrent »  It 
Sends  the  desired  anaiilar  positions  to  the  Pnp-i  i  .  The  PDF’-i  i  nasses 
these  values  to  the  D/A  converters.  Since  the  laser  deflection 
edulpnent  has  no  Position  feedhac<»  the  pr>p-n  nerelv  w^lts  an 
apDroprlate  lenqth  of  tl  le  and  then  starts  the  A/D  readlno  the  analoa 
value  (Proportional  to  the  rame  at  that  oointl  from  the  rame 
finder.  That  value  is  sent  back  to  the  ppp-IO, 

Provision  has  been  m^de  but  not  yet  implemented  to 
add  control  of  the  TV  camera's  Irisr  focus#  zoom,  and  color  wheels, 
and  also  to  a<^d  communication  with  the  VTP-tho  word  recoanltlor 
machine , 

2,  Laser  Ranae  Finder:  Random  Variation  of  the  Ranae 

veasurements  Arlsino  From  T moer feet  ions  of  the  Phase 
Measurind  Equipment 

a,  Backoround 

In  a  previous  report  [17]  a  discussion  was 
qlven  of  random  variations  of  ranqe  measurement  arlslnq  from  the 
finite  number  of.  quanta  received  by  the  photomultiplier  tube  durinn 
the  time  interval  of  a  measurement.  This  is  certainly  the  primary 
cause  of  rango  "noise,"  hut  it  is  not  the  only  source:  some  of  the 
observed  variability  can  be  attributed  to  the  ohase  measurlna 
equipment,  and  it  is  the  purpose  of  the  folio wlno  investloatlon  to 


provide  data  from  which  one  maV  estimate  that  component  of  the 
Observed  varlahllltv.  This  Is  not  to  Imply  that  the  Phase  measurina 
equipment  Is  defective  either  as  functioning  hardware  or  In  deslnn# 
hut  rather  to  recoonlze  that  the  dynamic  ranoe  over  which 
measurements  are  belna  taifen  Is  well  outside  the  deslon  for  the 
precision  we  require.  in  scannlna  a  field  of  view  that  Includes  an 
oblect  such  as  an  air  compressor,  the  innut  slanal  to  the  phase  meter 
may  coyer  a  dynamic  ranoe  of  105  dR,  made  un  as  follows: 


Variation  due  to  Inverse  square  law  \f>  :  \  ?4  dR 

Variation  In  reflection  coefficient  30  :  1  29  dR 

Specularreflectlon  20:1  2hdB 

Surface  orientation  20  :  1  26  dP 

where  the  maximum  slanal  comes  from  a  specular  reflection  from  a 
surface  close  in#  and  the  weakest  slanal  from  a  low  reflectivity 
surface  that  Is  almost  tanoentlal  to  the  scannlnq  beam  and  at  maximum 
ranqe , 


Flqure  57.  redrawn  from  the  HP  data  Jheet. 
shows  the  maonltude  of  the  offset  error  to  be  expected  In  the  output 
of  the  phase  m-ter  In  relation  to  the  dynamic  ranae  of  th*  cicnal 
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belna  ireasured.  This  Is  a  displacement  errors  not  a  random  variation 
error  C'nolse"  on  the  slonan,  and  by  Implication  Is  Independent  of 
the  slonal  level,  which  from  the  natiire  of  the  device  Is  rather 
unlikely. 


b,  Experimental  Observations 

Tests  for  phase  constancy  were  made  uslno  the 
followlnr  Dleces  of  equipment  made  by  Hewlett  Packard,  and  believed 
to  be  In  normal  oceratlna  condition: 

06O1A  Slonai  Generator  I  959  •  01135 

Network  Analyzer  l  qsg  .  00227 

®412A  Phase-Maqnltude  Dlsplav  $  968  -  00776 

As  an  Initial  check  the  laser  ranqer  was  used 
to  take  300  range  measurements  of  a  point  on  a  table  top  about  8  feet 
away--thls  represents  an  averaae  level  signal.  The  mean  ranoe  was 
96,88  Inches,  and  the  standard  deviation  was  0,607  Inches,  The  laser 
had  not  been  tuned  for  maximum  power#  and  there  was  nothing  unusual 
about  the  situation  in  general,  so  that  it  seems  fair  to  describe  the 
equipment  as  being  In  normal  condition. 

At  this  point,  the  two  Input  leads  coming 
from  the  photomultiplier  and  reference  beam  photodiode  were  removed 
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from  the  test  and  reference  Inputs  to  the  ohase  meter#  and  all  of  the 
subsequent  measurements  to  be  discussed  were  made  uslm  slqnals  from 
tne  «601A  Slanal  Generator,  the  slnole  cutout  from  which  was 
converted  to  dual  outnut  by  means  of  the  oower  splitter  llhSl  - 
60001,  In  oPeratinq  the  laser  ranoer  it  was  observed  that  tne  two 
vertical  slide  attenuators  on  the  Phase  Meter,  marked  Display 
Reference  dB»  and  which  presumably  affect  only  the  display  circuitry# 
nevertheless  do  interact  with  the  measurino  eouioment  and  in 
particular  affect  the  phase  displacement  error  associated  with 
limitinq  shown  in  Floure  57.  (When  scanninq  over  a  oray-scale  step 
Chart  at  constant  distance#  tne  ranoe  readlno  snowed  minimum  offset 
error  when  the  attenuators  were  at  +10  dn  and  +?dB,l 

Test  No,  1  Identical  Slonals  to  Both  Channels#  as  shown 

in  Figure  SB, 

Input  frequency  R.OOn  mmz  Bandwidth  100  Hz 

100  measurements  at  30  millisecond  intervals 
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FIGURE  58  TEST  1:  IDENTICAL  SIGNALS  IN  BOTH  CHANNELS 


The  -40  dH  level  corresponds  to  an  Input  slonal  of  ^  millivolts.  One 
inch  in  ranoe  corresponds  to  approximately  one  deoree  in  phase  shift. 
Thus,  for  relatively  hloh  input  levels,  identical  in  both  -hanneis, 
the  measurements  are  essentially  noise  fteej  hoWeVer,  the 
displacement  of  the  zero  hv  0.5  Inch  for  only  10  dB  chanoe  In  level 
Is  sionlflcant,  and  In  the  lioht  of  previous  experience  can  probahlv 
be  attributed  to  effects  In  the  reference  channel,  it  is  desirable 
to  adlust  the  reference  level  to  read  close  to  mid-scale  on  meter, 
and  not  merely  keep  it  within  the  Permissible  ranoe  marked  on  the 
dial , 

Test  No,  7  Reference  Channel  40  dB  Above  Test  Channel, 

as  Shown  In  Figure  5R. 


100  heasurements  at  .in  millisecond  intervals. 


The  reference  level  was  maintained  close  to  mid-scale  by  adjustment 


of  the  three  position  attenuator  o  the  Phase  Meter  panel.  This 
naturally  caused  displacement  of  tb**  ^ero  because  of  small 


differences  o’- 

wlrind  lenoths  within 

the  att'*nuatO’- » 

but  our  orimarv 

interest  was  in 

measurlnq  the  "noise 

"  level?  1 .  e  . 

,  t ne  standard 

deviation  of  the 

measur emtnt s  , 
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FIGURE  59  TEST  2:  NORMAL  CONDITION  OF  USE 


Frorn  the  above  measurements  It  is  evident 
that  random  variations  due  to  the  measuring  eaulprent  Itself  are 
slanificant  for  test  levels  below  lOO  microvolts.  Tt  Is  difficult  to 
arranoe  for  anv  test  scene  that  includes  the  cnmoressor  to  cover  a 
ranqe  of  less  than  70-R0  dB,  Moreover,  if  the  photc"'.:  1 1 1  pi  ler  oaln 
Is  Increased  to  raise  the  low -level  signals  until  thev  cause  the 
Phase  meter  to  operate  In  the  low-nolse  range,  then  the  preamplifier 
will  go  Into  nonlinear  operation  on  the  specular  reflections  and  will 
produce  substantial  positional  errors,  Tt  is  perhans  worth  pointing 
out  that  the  time  delay  of  the  signal  created  hv  a  ohot omu i t i pi i er  is 
not  Insignificant  In  the  present  context,  and  that  this  time  delay  Is 
a  function  of  the  power  sunnly  voltage,  which  Is  used  as  the  gain 
control.  Fluctuations  of  the  power  supply  voltage  therefore  modulate 
the  phase  difference  between  the  test  and  reference  channels,  and  are 
thus  a  further  source  of  "noise"  on  the  range  measurement, 

0.  Artificial  Intelligence  Center  Computer  Facility 

1.  Maior  Accomplishments 

Figure  no  shows  the  current  POP-10  Tfmfx  computer 
hardware  block  diagram.  The  two  malor  changes  during  this  contract 
year  were  the  total  replacement  of  all  existing  main  memory  (which 
was  very  unreliable!  with  a  new  258,nno-wrrd  memory  and  the 
replacement  of  a  five-drive  disk  system  (vhlch  was  also  very 
unreliable)  with  a  used  nine-drive  disk  system  that  Is  considerably 


better , 


TERMINALS 


PDP10  SYSTEM 


The  ooeratlna  system  software  has  iinderaone  a  ma1or 


restructurlnq  In  order  to  provide  moi^  CPU  cycles  to  the  users  at  a 
small  loss  In  Interactive  resoonse.  The  current  hardware/sof twar 
conf Iduratlon  now  routinely  delivers  R5  to  90  percent  of  all  CPU 
cycles  to  the  user  durina  peri')i‘s  of  normal  load, 

?.  Portents  for  the  Future 

The  current  comouter  faclUtv  Is  heavily  loaded  for 
about  flO  hours  per  weeir,  Fost  oi  our  research  proarams  are  limited 
by  our  computer  power  and  address  soace.  Both  of  these  areas  are 
belna  Investlqated  thorouahiy  in  order  to  provide  the  cnmoutlnq 
service  that  the  research  staff  needs. 
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APPENDIX 


CHOUSING  A  TASK  AHEA  FOR  THE  CMC  PPOvIECT 


A.  Criteria 

Given  that  our  CPC  system  is  to  be  an  expert  consultant  about 
some  complex  eiectromechanlca 1  eaulpment  of  interest  to  the  non, 
there  is  stlii  the  problem  ot  selectlno  some  specific  class  of 
equipment  from  among  thousands  of  military  Items,  we  have  acquainted 
ourselves  with  a  few  of  the  possible  candidates,  and  we  have  TooKed 
Into  some  of  them  aulte  thoroughly.  Our  prime  consideration  has 
been  to  select  an  Item  or  class  of  items  that  meets  certain  criteria 
that  we  have  adopted.  We  shall  discuss  these  criteria  first  and  then 
give  some  details  abput  the  equipment  we  nave  considered. 

1.  Relevance  to  noD 

The  equipment  should  be  of  a  tvne  for  which  Increased 
automation  of  maintenance  win  lead  to  substantial  cost  reduction 
and/or  Improved  operation. 
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2 


Amenabllltv  to  the  Use  of  Aotom^itlon  ^'ethorts 


The  eaulnment  and  Its  norn^al  use  should  be  such  that 
Computerized  mal ntenance  methods  (If  theY  can  bp  devpiopedl  are 
feasible  In  an  operational  settlna.  It  would  be  esoeclaliv  desirable 
If  there  were  already  bealnnlnn  attempts  to  use  computerized 
maintenance  methods  on  the  eoutpment, 

3,  Suitability  for  toe  Hesearc^  Goals 

The  enulpnent  must  be  such  that  the  research 
Performed  uslna  It  leads  to  broadly  useful  results  rather  than 
results  of  Interest  for  that  equipment  onlv. 

4,  Fxperlmental  Convenience 

Ttie  equipment  must  be  of  a  scale  and  complexity  that 
Permits  us  to  experiment  with  it  easily.  It  should  not  require 
inordinately  elaborate  test  aear  nor  should  It  he  too  difficult  or 
expensive  to  obtain, 

5,  Availability  of  Expertise 

There  should  be  a  wealth  of  information  about  the 

equipment  In  the  form  of  manuals,  drawlnns,  and  nearby  and  accessible 


human  experts 


B. 


Candidate  Equipment 


1 .  General 

i*(e  have  cons'dered  quite  a  fe'Ai  equipment  Items  and 
have  looked  into  four  of  them  in  some  detail.  Amonq  the  Items  we 
have  only  superficially  thouqht  about  and  rejected  for  various 
reasons  before  further  study  are*  automatic  manipulators  (such  as 
the  Unlmate  arm),  Instruments  such  as  ayroscoPes,  ref r loerat ion 
systems,  diesel  engines  for  tanks  and  trucks,  control-rod  actuatino 
mechanisms  for  nuclear  reactors,  larae  pneumatic  compressor  systems, 
toroedoes,  and  automatic  transmissions. 

The  four  Items  that  survived  Initial  screenlno  are 
jeep  engines,  hydraulic  flight  control  actuators,  generator  sets,  and 
the  steering  mount  for  the  awg-10  radar  for  the  A4  aircraft.  We  will 
comment  on  each  of  th*‘se  in  the  next  sections,  We  exnect  to  select 
one  Of  these  Items  shortly. 

2.  Jeep  Engines 


Jeep  engines  are  attractive  because  there  is  already 
an  automatic  system  currently  being  field  tested  for  diaonoslno  them. 
This  system  Is  the  ATE/ICE  being  develooed  under  contract  to  TACOM 
[461,  We  have  had  Initial  conversations  with  personnel  from  TACOM, 
Frankford  Army  Arsenal,  and  RCA  ./ho  have 


been  Involved  In  this 


orolPCt,  and  these  have  heen  on  the  vhole  quite  enco'iraolnn.  We 
would  be  able  to  build  on  the  exlstlm  technoloav,  addinn  'nore 
flexible  coirmunlratlons  and  more  oowerful  dlaanostlr  procedures. 
There  is  a  qood  chance  that  we  would  be  able  to  obtain  a  copy  of  the 
ATFJ/ICE  system. 

A  leep  would  be  reasonably  acceotable  from  the 
experimental  convenience  oolnt  of  view,  except  that  runninq  the 
enalne  inside  wwould  reaulre  special  v^ntlno  of  the  exhaust.  It 
scores  well  on  all  of  toe  other  criteria. 

3.  Hydraulic  Fllaht  Control  Actuators 

On  every  commercial  and  military  jet  airplane  there 
are  several  hydraulic  actuators  movlnq  flloht  control  surfaces  such 
as  elevators  and  ailerons#  These  are  moderately  complex  devices  that 
are  nontrivial  to  troubleshoot. 

We  have  not  vet  received  official  permission  to  visit 
the  Naval  Air  Pewor»f  Facility  at  Alameda  Naval  Air  Station  to  talk-  to 
the  appropriate  maintenance  OeODle#  but  in  the  meantlrre  we  visited 
the  maintenance  headauarters  of  United  Airlines,  There  we  learned  of 
the  Variety  of  different  actuators  for  commercial  aircraft  and 
somethlnq  about  the  maintenance  problems  involved. 


our  main  concern  aoout  woricirn  with  one  of  these 
actuators  is  experimental  convenience.  Some  of  these  considerations 
Inclu^je  the  sv:in  irritatinq  oroonrtles  of  the  hvdrauilc  fluid  used  in 
commercial  actuators  (mtiitarv  actuators  are  said  to  be  better  In 
this  reoardlf  the  problem  of  fluid  atomizin'.#  and  the  need  for 
several  kinds  of  special  sensors--e ,o, ,  flow  meters#  manometers# 
force  transducers#  position  transducers. 

There  is  a  oosslhlilty  that  we  could  use  United  Air 
Lines'  exis'lm  facilities,  and  this  would  solve  some  of  the 
experimental  problems. 

4.  Generator  5ets 

DoO  uses  a  wide  variety  of  oenerator  sets  ranoino 
from  small  portable  field  units  to  larne  power  systems.  All  of  the 
newer  ones  are  either  turbine  or  dlesel  nowered.  A  complete 
medium-sized  system  such  as  turbine  powered  FMii-30  (30  kW)  Involves 
complex  electronic#  electrical#  and  mechanical  subsystems. 

We  visited  the  Generator  llasion  office  at  McClellan 
Air  Force  Base  in  California  to  learn  more  about  the  characteristics 
of  Generators  and  their  maintenance  problems.  Uur  conclusions  are 
that  a  system  could  be  chosen  of  the  rlaht  level  of  difficulty#  but 
there  are  some  severe  experimental  convenience  problems:  they  are 
veiv  noisy. 


5 


The  AwG-in  Steerable  Ha  tar  ’’ount 


Vve  (ilscusseh  the  steerable  radar  ^cunt  for  the  .AW(;-in 
radar  used  in  the  A4  aircraft  at  virairar  Naval  Ajr  Station.  This  is 
a  coirnlex  device  contalnin  nrotors  and  servos  to  aim  the  radar 
antenna.  It  is  of  about  the  rlnht  size  ohvsicallv  and  would  he 
ODtImai  from  an  exoerlmental  convenience  oolnt  of  view. 

Ke  nave  some  concern  that  it  miaht  nof  represent  a 
maintenance  problem  of  sufficiently  oeneral  lnterest»  and  we  have 
also  experienced  certain  difficulties  already  In  aettino  the 
appronriate  Navy  publications  descrlblno  it. 
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